When viewing resources produced by Pipeline Builder in Data Lineage, the graph renders each Pipeline Builder as a single multi-input multi-output transform with each input to a Pipeline feeding into the transform & each output from that Pipeline coming out of that transform.
This isn’t correct though. Imagine the following pipeline:
InputA -> OutputA
InputB -> OutputB
In this case, InputA
is not an input of OutputB
, but Data Lineage displays this as the case.
Is it possible for Data Lineage to show correct transformation paths instead of everything from each Pipeline Builder grouped together?