Schedule disappeared Misteriously

Ask the Community
,
1

Yesterday morning, schedules disappeared on our pipeline and its causing measure issues as we are facing significant issues.

image
image1007Ă—897 105 KB

We even had checkpoints setup to track deletion but there is no report of it.

Missing schedules api needed 2
Missing schedules api needed 21320Ă—903 18.4 KB

Could it be a bug in the system? Its very frustrating. Please advice ASAP.

2

Hello,

Thanks for your post. A note first: Community is not intended for bug support and is answered on a best-effort basis. If you expect an answer under a specific timeline, you should use your usual support channel (for example Foundry Issues on your own Foundry enrollment). Community is a way to share “how-to” questions and answer, for example.

As a reminder of the community guidelines:
Participation in this community is entirely voluntary, and as such there are no guaranteed responses or SLAs. If you are a Palantir customer with a support contract and require a response, or need to reference information that cannot be made public, please raise a Support request via normal channels. This includes bug reports and feature requests.
See community guidelines: https://community.palantir.com/t/welcome-to-the-developer-community/258

On the issue itself:

  • If the schedule has been deleted, you won’t find the schedule in this UI indeed. However, the same prevails if the schedule has been edited and no longer includes this dataset.
  • A schedule can encompass multiple datasets. You should open your dataset in Data Lineage, and look at the right side panel about “Schedules” and see which schedule applies to your pipeline as a whole. See https://www.palantir.com/docs/foundry/data-lineage/manage-schedules

image
image399Ă—952 69.4 KB

  • You can pivot from a build to a schedule via the UI in Data Lineage - This will also give you information if the schedule still exists or not, and/or if it was edited since then:

    image
    image1140Ă—293 26.8 KB

  • If you have the RID of the schedule, you can then get more information about the schedule, including it’s current state, by navigating to workspace/scheduler/metrics/ri.scheduler.main.schedule.<the-rest-of-the-rid>

  • You will need to check the scope of the checkpoint. You can as well validate by creating and deleting a schedule what is the behavior (and if you get a particular checkpoint event created properly).

In a worst case scenario, you should look at the audit logs to understand if a deletion event has been triggered on this scenario, on by whom.
https://www.palantir.com/docs/foundry/security/audit-logs-overview

You can look for “DELETE_SCHEDULES” event.

1 Like