For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.
Providers
Learn how to configure agentgateway for a particular LLM.
Custom providers
Use custom providers for self-hosted or non-managed LLM providers when you want to declare supported API formats, upstream paths, and backend targets explicitly.
OpenAI-compatible providers
Popular OpenAI-compatible providers include Mistral, DeepSeek, Groq, Together AI, Perplexity, and Fireworks AI.
Amazon Bedrock
Anthropic
Azure
Configuration and setup for Azure AI services provider
Gemini
OpenAI
OpenAI-compatible providers
Vertex AI
Custom providers
Configure self-hosted and non-managed LLM providers with explicit API formats, paths, and backend …
Ollama
Configure agentgateway to route LLM traffic to Ollama for local model inference
vLLM
Configure agentgateway to route traffic to vLLM for self-hosted model inference
Multiple endpoints
Mock LLM with httpbun
