Is there an easy way to migrate an output dataset from one builder pipeline to another. basically i have a pipeline that produces a dataset, and i want to instead move that transformation to a different pipeline without creating a new output dataset
There is! In your new Builder file, if you navigate to your “Pipeline Outputs” tab, then create a new dataset, in the output definition there is an ellipses in the top right - in this menu is the “Overwrite dataset” button that will allow you to take your existing pipeline logic and write it to an existing dataset. If the other dataset is backed by another Pipeline Builder file like in your case, then Builder will automagically handle all of the plumbing for you. If the other dataset is backed by another Foundry dataset generation tool, like Code Repositories or Code Workbook, you’ll need to first delete the Job Spec in the details tab of that dataset before you overwrite it from Builder
1 Like