Can I execute a Model on a Stream in Foundry?

VincentF
Thu, 20 Jun 2024 15:40:51 +0000
Ask the Community

I know this is possible to execute a call to AIP in Pipeline Builder in streaming mode.

I want to execute a model (not AIP/not an LLM) as part of a streaming pipeline.
This model is a “Model” in Foundry (it could be a sentiment analysis BERT model, an audio transcription model, a remote model available via API call…)

How can I do this ? Is it possible ?

4 posts - 3 participants