I’m trying to setup a schedule on a transform/dataset that ingests data into Foundry via calling an external API on a daily basis. This is expected to run at 11pm ET every day.
However, the API server will be undergoing maintenance at that time on Saturday, so I want to set it to run earlier (5pm ET).
Can I do this using a single schedule?
(Tagging as data health, but ideally we have a new tag for pipeline schedules?)
Hi Sharan,
I believe there is a scheduler
community tag you can use.
And I think the best way to accomplish this is to configure the schedule’s trigger to be an OR of two separate cron schedules. The first cron schedule would run Sunday-Friday at 11 PM ET, and the second cron schedule would run only Saturdays at 5 PM ET. Please see the Foundry platform documentation for more information regarding supported scheduler triggers.
Blockquote
1 Like