You’re right, all of AIP’s Palantir-provided models are quite locked down, and don’t allow the LLMs to directly access the web, or any external systems, outside of your control. @nicornk’s post is a good overview of how you can give an LLM web access as a tool, subject to the limits and network egress policies you define.
Additionally, as of recently, you can also bring your own LLM, and register it as a model in AIP via a Function interface. This lets you integrate a search-capable model (e.g. Perplexity), using your own key.
- Docs: https://www.palantir.com/docs/foundry/functions/chat-completion-function-interface-quickstart
- Announce: https://www.palantir.com/docs/foundry/announcements/2024-11#register-any-external-llm-as-a-specialized-typescript-function-and-use-it-in-logic-ga
Give it a spin!