AI Glossary
Rate limit
What does “Rate limit” mean?
Rate limit: A cap a provider puts on how much you can use its API in a given time, often counted in requests per minute or tokens per minute. Going over usually returns an error asking you to wait. Limits protect shared capacity and often rise with account tier or usage history.
What is an example of “Rate limit”?
An app that suddenly sends thousands of requests at once may get "too many requests" errors until it slows down or retries later.