Are API requests rate-limited?

Tags:

API

Requests to the Cloud API are generally limited to 1 request per second.

Requests to the /instance-operations/launch endpoint are limited to 1 request every 10 seconds.

Note

If you’re being rate limited, you’ll receive an HTTP 429 response status code in response to your request.

Note

The request rate limits may change at any time.

Feedback

Was this page helpful?

Glad to hear that! Email us with any suggestions on how we can improve our docs.

Sorry to hear that. Please email Support for help.

Last modified January 27, 2023: Add ® to mentions of PyTorch (0194e62)