Automating Dataset View Creation for Multiple Datasets

Ask the Community
1

Hello, is there a way to create multiple dataset views for each dataset? For example, I have 16 datasets, and I want to create a view for each one. It’s painful to do this manually for every dataset. Is there a way to automate it and keep the same dataset input names? Thanks

2

Hey assuming you’re talking about these views https://www.palantir.com/docs/foundry/data-integration/views/ this isn’t something that’s supported in Pipeline Builder. I’ll let other folks chime in on the feasibility in code repositories as I’m not sure if there’s a way to automate it there

3

I think you could write a script using the public api using the create view endpoint.

If you want this to be run as a regular transform, you can write an external transform that gets all your datasets in folder A and all views in folder B. Then for each dataset that does not have a view in folder B, you can create a view using the public api (or via the Public API via the Foundry Platform SDK).

1 Like
4

Hello, thanks for that, yes I’ll Check it and I’ll get back to you thanks

5

Hello, what is the recommended way to create an API? Since I’m using a Code Repo within the same Foundry stack, I don’t need to use a token or specify the hostname. Could you please provide an example if you have one? Thanks!

6

You don’t need to create an API.

You need to create a Rest API Source with an Egress Policy to your foundry stack hostname. In the Source you can store a Foundry token or Third Party App Client_id and client_secret as Secrets.

You can than import that into an external transform and use it to make API calls to the create view API.

1 Like