Hello,
I’m looking to create a custom upload progress visualization within a workshop module, similar to the one shown in the image:
When a user uploads a document from the workshop, it will undergo data transformation in the pipeline. To improve user experience, I want to display the pipeline’s progress, which will take some time.
Are there any existing components or libraries that can help with this? If not, what’s the recommended approach?
Hello Herson,
There is nothing out of the box for this.
It is hard to predict how long a pipeline would take. One run might only have 1GB of new data, and the next run might have 1TB of new data - and clearly the second one will take a lot longer than the first. Put another way, making this accurate is not easy at all.
My approach would be to understand: how many nodes are there in your pipeline? What is the average time for each node? And heuristically attribute a percentage to each node, and use the build status of that node to accumulate the percentage up to 100%.
The build status can be fetched using this API: https://www.palantir.com/docs/foundry/api/v2/orchestration-v2-resources/builds/get-builds-batch/?productId=foundry&slug=orchestration-v2-resources&slug=builds&slug=get-builds-batch
To get this in workshop, you’ll need to turn this into a function call, or more easily you can use a workshop widget to display an embedded slate application or other developer console create application via an iframe.
An approach I’ve taken is to iframe in - use the ?embedded=true query param to embed without the sidebar - the view to the Job Tracker UI with the build id (how you get this id will depend on how you kick off the build).
Especially if there are multiple jobs in the build, this can be a helpful view, and it will automatically give some heuristics about the expected time for each job based on previous runs.
Again, with more implementation details on the pipeline and a broader picture of how you’ve set up the user-facing portion of the workflow, we could probably give some more holistic advice about how best to architect this solution.
This is unexpectedly a very helpful idea. thanks
This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.
