I have a folder in foundry with many raw files (.csv, .xlsx). I want to grab all of the files and put them files into a single dataset. I don’t want to download the files and re-upload them into a dataset. How would i do this in code repositories with a transform? what foundry apis would i use?
You should be able to leverage the Public API to list, get and upload files to a new dataset.
If using python, I’d recommend using the Palantir Platform SDK to interact with the public api.