Pipeline builder for creating transformed data

I’ve built a transformed table via Pipeline and I’m trying to set up a scheduler so it refreshes whenever the upstream data changes. This transformed table depends on two upstream sources. In the Scheduler UI, I can only select one source as the trigger, not multiple.

Goal: Refresh the transformed table when either upstream source changes.

Questions:

  1. Is there a way to configure the scheduler with multiple upstream dependencies (trigger on any change)?

  2. If not, what’s the recommended pattern?

Thank yo.

Hey @Coder ! You should be able to select multiple datasources in Pipeline Builder to trigger your schedule:

Are you running into issues with this feature? I selected two input nodes on my graph and then the “2 datasets” appear next to the Selected field. I would then click +Add

1 Like

This topic was automatically closed 91 days after the last reply. New replies are no longer allowed.