Docs/API
Limits and caps
How fast can I go, how big can a request be, and how do I stop a script overspending?
Checked against the code on
| Limit | Value | Where it bites |
|---|---|---|
| Requests per minute | 120 per IP address | 429 with no message body change. Back off. |
| Request body | 256 KB | 413 |
| Conversation | Last 40 messages; 120,000 characters | Older messages dropped; over the character limit is 400 |
| Output | max_tokens up to 8,192, default 4,096 | Clamped, never rejected |
| Upstream deadline | 120 seconds | 504, charged, because the model ran |
| Active keys | 20 per account; 10 created per hour | 400 from the wallet |
| Daily cap per key | Optional, in credits, rolling 24 hours | 429 rate_limit_error before the call |
There is no per-account request limit
The IP limit protects the service. The daily cap protects your balance, and it is the one to set. It is checked against the worst case a request could cost before the request runs, so a capped key cannot go over, even by one request.
Need more
Higher IP limits for a server that fans out on behalf of many users: email ask@heyaskr.ai with the address and the shape of the traffic.