Current list of countries for each model provider / model

[Yasuhito]

I understand that if my enrollment is not geo-restricted, requests to AIP can be routed to model providers in various countries, and the list of countries for which requests to a given model provider are routed is subject to change over time. That said, purely for reference purposes, could you share the current list of countries for each model provider / model as listed under https://www.palantir.com/docs/foundry/resource-management/llm-capacity-management#enrollment-capacity-and-rate-limits ?

[lkaminer]

There are two types of routing on AIP: (1) geo-restricted, where requests are only processed in certain regions (US, EU, UK, CA, AU, Japan are the main regions supported); and (2) non-geo-restricted, where requests can be routed to any region. In both cases, Zero Data Retention is guaranteed.

To your question, the list of countries depends on the model provider and on the specific model version. A few examples:

• For GPT models provided by Azure OpenAI, the potential list of regions is here: https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models?tabs=standard%2Cstandard-chat-completions#standard-deployment-model-availability ; most data is sent to backends in US and EU, but there are also cases where it’s routed to India, Canada, Japan, Switzerland, etc.
• For Claude models provided by AWS Bedrock, the full list of regions is here: https://docs.aws.amazon.com/bedrock/latest/userguide/models-regions.html
• For Palantir-hosted Llama models, requests are routed a single region that is usually similar to where your stack is hosted, but you can reach out to your Palantir POC for details.
• This isn’t an exhaustive list.

Note: if this is a matter of compliance and legal requirements, we highly recommend to get in touch with your Palantir POC and if required, have a Palantir legal expert involved. Palantir is working closely with all major model providers and provides a variety of solutions to compliance requirements, including data residency.