Incremental Build on Materialized Dataset from Object

Hi everyone,

I’m encountering an issue with incremental transformations on a materialized dataset. This dataset is sourced from a Foundry Object, and its build interval is set to “Automatic”.

The error I’m seeing is:
Job cannot run incrementally: Input dataset has a new view: previous view was starting at [xxxx], and current view is starting at [yyyy]

Does anyone know if this issue is caused by the materialized dataset, or by how my incremental transformation reads this dataset?

Thanks!

Hi Helen,

Materializations are not incremental, you have to manage the diff yourself. We are aware of this as FR, but not working on it this summer yet. I added your note onto our internal tracking (objects-writeback/issues/7747),

1 Like