# How can I monitor a raw input stream for liveliness? **URL:** \ **Category:** Ask the Community\ **Tags:** data-health, streaming\ **Created:** [April 29, 2024, 8:41pm UTC](https://community.palantir.com/t/how-can-i-monitor-a-raw-input-stream-for-liveliness/171 "2024-04-29T20:41:38Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![dherls](https://yyz1.discourse-cdn.com/palantir/user_avatar/community.palantir.com/dherls/32/19_2.png) [@dherls](https://community.palantir.com/u/dherls)\ **Post date:** [April 29, 2024, 8:41pm UTC](https://community.palantir.com/t/how-can-i-monitor-a-raw-input-stream-for-liveliness/171/1 "2024-04-29T20:41:38Z")
We can monitor derived streams with some of the monitoring view options for checkpoints, but raw streams from a data ingest do not have checkpoints. How can I ensure that records are flowing through my raw stream? ---
**Author:** ![tpark](https://avatars.discourse-cdn.com/v4/letter/t/71c47a/32.png) [@tpark](https://community.palantir.com/u/tpark)\ **Post date:** [May 2, 2024, 2:28pm UTC](https://community.palantir.com/t/how-can-i-monitor-a-raw-input-stream-for-liveliness/171/3 "2024-05-02T14:28:45Z")
Hi! Monitoring for raw stream ingests is in active development. We will reach back out once this is generally available. Out of curiosity – when would you want an alert to fire? For example, “alert when 0 records have been ingested in the last 30 minutes”. ---
**Author:** ![dherls](https://yyz1.discourse-cdn.com/palantir/user_avatar/community.palantir.com/dherls/32/19_2.png) [@dherls](https://community.palantir.com/u/dherls)\ **Post date:** [May 2, 2024, 4:37pm UTC](https://community.palantir.com/t/how-can-i-monitor-a-raw-input-stream-for-liveliness/171/4 "2024-05-02T16:37:36Z")
Hi @tpark there would be a few scenarios I would want to alert on - The one you mentioned about number of records - Looking at the timestamps in incoming records to see if they are more than X minutes in the past - Whether the stream is actually running or not right now. The schedule monitoring is not good enough for this because streaming schedules always end in failure. ---
**Author:** ![tpark](https://avatars.discourse-cdn.com/v4/letter/t/71c47a/32.png) [@tpark](https://community.palantir.com/u/tpark)\ **Post date:** [May 2, 2024, 5:01pm UTC](https://community.palantir.com/t/how-can-i-monitor-a-raw-input-stream-for-liveliness/171/5 "2024-05-02T17:01:43Z")
@dherls Thanks for the context. > Looking at the timestamps in incoming records to see if they are more than X minutes in the past Would you alert on `now - time record is created in source system` or `now - time record enters Foundry`? > Whether the stream is actually running or not right now. Gotcha, we’re thinking of this as a “Liveness” monitor. We will decomp this and and look into adding it to our roadmap. ---
**Author:** ![dherls](https://yyz1.discourse-cdn.com/palantir/user_avatar/community.palantir.com/dherls/32/19_2.png) [@dherls](https://community.palantir.com/u/dherls)\ **Post date:** [May 2, 2024, 5:27pm UTC](https://community.palantir.com/t/how-can-i-monitor-a-raw-input-stream-for-liveliness/171/6 "2024-05-02T17:27:22Z")
For raw streams, definitely `now - source system`. For later derived streams, `now - time record enters foundry` would be a good indicator of total e2e processing time ---
**Author:** ![system](https://yyz1.discourse-cdn.com/palantir/user_avatar/community.palantir.com/system/32/3_2.png) [@system](https://community.palantir.com/u/system)\ **Post date:** [November 22, 2024, 10:47am UTC](https://community.palantir.com/t/how-can-i-monitor-a-raw-input-stream-for-liveliness/171/7 "2024-11-22T10:47:11Z")
---
**Author:** ![system](https://yyz1.discourse-cdn.com/palantir/user_avatar/community.palantir.com/system/32/3_2.png) [@system](https://community.palantir.com/u/system)\ **Post date:** [May 6, 2025, 2:11pm UTC](https://community.palantir.com/t/how-can-i-monitor-a-raw-input-stream-for-liveliness/171/8 "2025-05-06T14:11:12Z")
---
**Author:** ![system](https://yyz1.discourse-cdn.com/palantir/user_avatar/community.palantir.com/system/32/3_2.png) [@system](https://community.palantir.com/u/system)\ **Post date:** [February 13, 2026, 3:37pm UTC](https://community.palantir.com/t/how-can-i-monitor-a-raw-input-stream-for-liveliness/171/9 "2026-02-13T15:37:12Z")