Hi There,
I am building a chat bot that has to do some logic and use data in Foundry before responding. I have it working with a Foundry function that hits an LLM and returns the response, but I would strongly prefer to have the response streamed back, so the chat experience feels faster. The end goal will be to call this function from an OSDK app running on mobile. What is the best way to do this?
Thanks,
Andrew Girvin