Hey folks, I have an external endpoint that produces data at the sub-5 second scale. The only way to interact with the endpoint is through an API call. I currently do this through an external transform that builds every minute. I would like to convert this into a streaming sync. Any ideas on how I …

Unfortunately, this is not currently possible.

But can he run the poll every minute and then, in the transform, push the new records to a stream? So the rest of the pipeline is a stream?

Since this question was asked, compute modules were released. This is something you should be able to accomplish with a compute module since it’s long-running.

Palantir Developer Community

Streaming Sync Based on API

Ask the Community

streaming, data-connection

show post in topic

Home
Categories
Guidelines
Terms of Use
Privacy Policy

Powered by Discourse, best viewed with JavaScript enabled

Privacy Statement Cookie Statement