Does foundry have functionality to perform column name mapping in PB? We have datasets that have dynamic columns and pipeline builder seems to not do great with this. For example, can we do something like “if a column exists, rename it to this”
I don’t think Pipeline Builder supports this case currently. What are some other examples you would like to input as conditions?
Hi, Pipeline Builder requires you to define your columns upfront because all of our functions are strongly typed. We automatically limit the functions and conditions you can choose based on your schema, so we must know the schema upfront.
Have you tried wide unioning the dataset inputs with an empty manually entered table with all of the columns that could appear? You can then rename said column because it’ll always exist.