Skip to content
CTRL K
    Docs Standalone Kubernetes Tutorials Standalone Kubernetes Models Blog Enterprise Community Get Started GitHub

    Providers

    Learn how to configure agentgateway for a particular LLM.

    OpenAI-compatible providers

    Popular OpenAI-compatible providers include Mistral, DeepSeek, Groq, Together AI, Perplexity, and Fireworks AI.

    Amazon Bedrock

    Anthropic

    Azure OpenAI

    Gemini

    OpenAI

    OpenAI-compatible providers

    Vertex AI

    Ollama

    Configure agentgateway to route LLM traffic to Ollama for local model inference

    vLLM

    Configure agentgateway to route traffic to vLLM for self-hosted model inference

    Multiple endpoints

    Mock LLM with httpbun

    Was this page helpful?
    Agentgateway assistant

    Ask me anything about agentgateway configuration, features, or usage.

    Note: AI-generated content might contain errors; please verify and test all returned information.

    Tip: one topic per conversation gives the best results. Use the + button in the chat header to start a new conversation.

    Switching topics? Starting a new conversation improves accuracy.
    ↑↓ navigate ↵ select esc dismiss

    What could be improved?

    Your feedback helps us improve assistant answers and identify docs gaps we should fix.

    Need more help? Join us on Discord: https://discord.gg/y9efgEmppm

    Want to use your own agent? Add the Solo MCP server to query our docs directly. Get started here: https://search.solo.io/.