Incremental Build on Materialized Dataset from Object

Hi everyone,

I’m encountering an issue with incremental transformations on a materialized dataset. This dataset is sourced from a Foundry Object, and its build interval is set to “Automatic”.

The error I’m seeing is:
Job cannot run incrementally: Input dataset has a new view: previous view was starting at [xxxx], and current view is starting at [yyyy]

Does anyone know if this issue is caused by the materialized dataset, or by how my incremental transformation reads this dataset?

Thanks!

Hi Helen,

Materializations are not incremental, you have to manage the diff yourself. We are aware of this as FR, but not working on it this summer yet. I added your note onto our internal tracking (objects-writeback/issues/7747),

1 Like

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.