How to force a snapshot pipeline in PB?

Ask the Community
1

the docs recommend snapshotting your incremental pipelines every now and then; is there support in PB to force a snapshot build in an incremental pipeline? do you just:

  • change the write mode to snapshot
  • deploy
  • change the write mode back
    ?
2

Hey, the correct way to do this is to change your input read mode to snapshot with the default write mode (this will cause the build to read the entire input dataset and output a snapshot transaction). If you only change the write mode, your output dataset will be overwritten with only your incremental changes.

2 Likes