Allow for Underlying Pipeline Builder Preview & Changes within Data Lineage Code Tab

Was wondering if there was any corresponding functionality to the Quick Edit feature for authoring transforms in data lineage? It’d be awesome to be able to update and manage the eddie transforms backing a dataset directly within the monocle UI like we can with authoring transforms.

Hey @andrewbowen, thank you for the post.

This ask comes up frequently in two primary forms. The first is yours, in which users would like to edit the underlying Builder logic from within Monocle. The second is a subset of that, in which users would like to see the backing Builder logic in Monocle.

Currently, neither are technically feasible because of the complexities around rendering Builder graphs in Monocle, but there’s active work to enable that. I expect we’ll be able to achieve the second as a result, allowing you to see the corresponding Builder logic when in Monocle. I currently doubt we’ll invest in the first ask of being able to also edit that pipeline though for a few reasons:

  • The entire editor is large and complex and won’t fit sanely into a drawer or dialog in Monocle
  • Trying to put part of the editor in Monocle may mean pruning off features that are actually required to edit, save, and deploy a pipeline
  • The work to enable editing pipelines from different apps is significantly larger and different than the work to enable viewing pipelines from different apps

Viewing Builder logic from Monocle should be available on the order of months. We can strongly tie that readonly view back to the pipeline to make that jumping off point as efficient as possible.

2 Likes