For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.
Rate limiting
Limit the number of requests that clients can send to your backends, either per gateway replica or across all replicas.
Local rate limiting
Apply local and global rate limits to HTTP traffic to protect your backend services from overload.
Global rate limiting
Apply distributed rate limits across multiple agentgateway replicas using an external rate limit …
Budget and spend limits
Redirects to the budget and spend limits guide, which caps LLM token usage and spend.