I’m getting a build failure caused by: “MediaSet:CannotReadMediaSetBranch”. According to Data Lineage, the media set does not exist on main (see screenshot below). In a simplified pipeline pasted below, Media Set XLSX Output can build, but Dataset XLSX Output fails to access a media set item (CannotReadMediaSetBranch) after converting media reference to a logical type: Media Reference.
For context, I need to develop a drop zone where users can upload the latest Excel extract from a business system. I tried to use a media set backed property in an ontology action type, and this error is blocking me from using the Excel files from the materialization for downstream processing.
Please advise both about steps to resolve this error and alternative workflows.
Thank you for reaching out. This is a limitation of the build system right now: for permission control, the build uses a minimal scoped token that only has access to the resources directly used in the build, and the build can only access a media reference if the media set itself is an input of the build. In your case, the build originating from “Simulated Materialization” only has access to the dataset but not the media set, which led to the error.
We are looking into updating the build infra to better handle pipelines like this. In the meantime, a workaround is to add the media set into the build by joining it with the dataset (the join does not need actually do anything: you can drop all rows from the media set before joining, and let the join simply keep all rows from the dataset).
