Skip to content
CTRL K
    Docs Standalone Kubernetes Models Blog Enterprise Community Get Started GitHub
    agentgateway has joined the Agentic AI Foundation — Learn more

    For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.

    Page as Markdown
    Models
    Serve LLM models in Kubernetes with the model-centric AgentgatewayModel API.
    Define the models you serve, and let agentgateway generate the LLM routing for you.
    About models
    Learn how the AgentgatewayModel API provides a model-centric way to serve LLMs in Kubernetes.
    Serve a model
    Expose an LLM model to clients with an AgentgatewayModel resource, including wildcard matching and …
    Virtual models
    Publish one client-facing model name and route requests across several models with weighted, …
    ProvidersModel aliasing
    Was this page helpful?
    

    
Agentgateway assistant
    


    Ask me anything about agentgateway configuration, features, or usage.
    Note: AI-generated content might contain errors; please verify and test all returned information.
    Tip: one topic per conversation gives the best results. Use the + button in the chat header to start a new conversation.
    Switching topics? Starting a new conversation improves accuracy.

    ↑↓ navigate
↵ select
esc dismiss
    

    

    What could be improved?
    Your feedback helps us improve assistant answers and identify docs gaps we should fix.
    Need more help? Join us on Discord:
https://discord.gg/y9efgEmppm
    Want to use your own agent? Add the Solo MCP server to query our docs directly. Get started here:
https://search.solo.io/.