LLM Providers
Agentgateway supports multiple LLM providers, allowing you to route requests to different AI models and manage API keys centrally.
GPT-4, GPT-4o, and more
Claude models
Azure-hosted OpenAI models
AWS foundation models
Gemini models
Google Cloud AI platform
xAI, Cohere, and other compatible APIs
Route to multiple LLMs
Quick start
To use an LLM provider with agentgateway, configure an ai backend.
# yaml-language-server: $schema=https://agentgateway.dev/schema/config
binds:
- port: 3000
listeners:
- routes:
- backends:
- ai:
name: my-llm
provider:
openAI:
model: gpt-4o-mini
policies:
backendAuth:
key: "$OPENAI_API_KEY"See LLM Consumption for complete documentation on working with LLM providers.
