Hey! I have a set of syncs currently running as snapshots that I want to switch to incremental appends. Is there a way to force a snapshot on the first build/remove existing transactions in order to avoid duplicate data after doing the switch?
hey @fnk !
If these are JDBC syncs, it’s a bit convoluted at the moment, you’d need to:
- enable incremental while keeping a SNAPSHOT
- save and run the sync - this overwrites existing data and sets an initial value for the incremental parameter
- switch to APPEND
- save the sync
on the next run, only the delta will be ingested.
Hope this makes sense,
Barth