What's the FoundryAPI rate limit?

Ask the Community
1

What’s the Foundry API rate limit? The documentation just says that there is one but gives no indication of what it is.

2

There is some information in the docs - sharing a snippet below

Limits

We implement rate limits on requests to Foundry APIs to safeguard the system from being overwhelmed by excessive data and to fairly allocate system resources.

Be advised that these restrictions and allocations may be subject to alterations.

Callers should not rely on counting requests, but should instead implement exponential backoff in response to 429 and 503 responses.

Concurrency Limits

  • Individual users can make up to 30 concurrent requests at a time.
  • OAuth2 apps have no fixed concurrency limit at this time.

Concurrent requests over the limit will get throttled and receive a 429 error.