Unexpected Delay Between Jobs in Live Pipeline

Hi everyone,

I’m encountering a strange delay between jobs in my Live Pipeline and wanted to ask if anyone has experienced something similar.

However, despite these fast runtimes, there’s an unexpected 11-minute delay between each job:

  • Change Log starts at 11:29 pm
  • Merge Changes doesn’t begin until 11:38 pm
  • Indexing starts at 11:49 pm

I’m on the AIP Developer Tier, and have been using Foundry for 6 months. This issue first appeared on June 21st—before that, everything ran smoothly.

For context, the underlying dataset has only 3 rows and 3 columns, and it appears healthy. I eventually received all 3 objects after about 30 minutes, but the lag between jobs is puzzling.

Any insights into what could be causing this would be greatly appreciated!

Thanks in advance.

Hello, @SCOU7 would it be ok if I reach out to you directly?

Thank you

Hi, @ogstevan

sure—please feel free to message me directly.

It’s been about 20 hours since I posted, and roughly three days since the issue began.

The problem is now gone, and the Pipeline is running super fast—just like before.

I’m not sure what happened—maybe just a couple of unlucky days, or maybe someone quietly fixed it behind the scenes. Either way, that’s the end of the story.

If anyone behind the scenes helped resolve this—whether you saw this post or not—thank you so much. I truly appreciate it.

Thank you for asking this question, we’ve identified the issue internally yesterday and remediated. I didn’t reach out directly because we were able to identify the issue with internal monitoring.

Apologies for disruption.

Thanks for the update—and for fixing it so quickly! Much appreciated.