# Documentation > Agentgateway documentation for Kubernetes and standalone binary deployments. For the full index see [llms.txt](/llms.txt). ## Agentgateway on Kubernetes - [Inference routing](https://agentgateway.dev/docs/kubernetes/latest/inference.md): Use agentgateway with the Kubernetes Gateway API Inference Extension to route requests to AI … ### Get started - [Install agentgateway](https://agentgateway.dev/docs/kubernetes/latest/quickstart/install.md): Install the agentgateway control plane and get agentgateway running in your cluster. Agentgateway is … - [LLM (OpenAI)](https://agentgateway.dev/docs/kubernetes/latest/quickstart/llm.md): Configure OpenAI as an LLM provider in agentgateway. Don’t have an API key to an LLM provider? … - [MCP servers](https://agentgateway.dev/docs/kubernetes/latest/quickstart/mcp.md): Route to a Model Context Protocol (MCP) server through a static address. For more information, see … - [Non-agentic HTTP](https://agentgateway.dev/docs/kubernetes/latest/quickstart/non-agentic-http.md): The httpbin app lets you test out agentgateway for non-agentic HTTP traffic by sending requests to … ### About - [Overview](https://agentgateway.dev/docs/kubernetes/latest/about/overview.md): Agentgateway is an open source, AI-first data plane that provides connectivity for agents, MCP … - [Architecture](https://agentgateway.dev/docs/kubernetes/latest/about/architecture.md): Learn more about the components that make up the agentgateway control and data plane. These … - [Gateway API](https://agentgateway.dev/docs/kubernetes/latest/about/gateway-api.md): Agentgateway is based on the Kubernetes Gateway API. Gateway API is an official Kubernetes project … - [Policies](https://agentgateway.dev/docs/kubernetes/latest/about/policies.md): The AgentgatewayPolicy custom resource lets you apply traffic management, security, observability, … ### Install - [Helm](https://agentgateway.dev/docs/kubernetes/latest/install/helm.md): In this installation guide, you install the agentgateway control planeControl PlaneComponents that … - [ArgoCD](https://agentgateway.dev/docs/kubernetes/latest/install/argocd.md): In this installation guide, you install agentgateway in a Kubernetes cluster by using Argo CD. Argo … - [FluxCD](https://agentgateway.dev/docs/kubernetes/latest/install/flux.md): In this installation guide, you install agentgateway in a Kubernetes cluster by using Flux. Flux is … - [Sample app](https://agentgateway.dev/docs/kubernetes/latest/install/sample-app.md): The httpbin app lets you test out agentgateway for non-agentic HTTP traffic by sending requests to … - [Advanced settings](https://agentgateway.dev/docs/kubernetes/latest/install/advanced.md): You can update several installation settings in your Helm values file. For example, you can update … - [TLS encryption](https://agentgateway.dev/docs/kubernetes/latest/install/tls.md): Enable server-side TLS encryption for the xDS gRPC server in the agentgateway control plane. For … ### Gateway setup - [Set up an agentgateway proxy](https://agentgateway.dev/docs/kubernetes/latest/setup/gateway.md): Set up an agentgateway proxy. Before you begin Install the agentgateway control plane. Set up an … #### Listeners - [Listener overview](https://agentgateway.dev/docs/kubernetes/latest/setup/listeners/overview.md): Set up listeners on your agentgateway proxy. A listener configures how your proxy accepts and … - [HTTP](https://agentgateway.dev/docs/kubernetes/latest/setup/listeners/http.md): Create an HTTP listener on your gateway proxy. Your proxy listens for HTTP traffic on the specified … - [HTTPS](https://agentgateway.dev/docs/kubernetes/latest/setup/listeners/https.md): Create an HTTPS listener on your agentgateway proxy so that your proxy listens for secured HTTPS … - [mTLS (FrontendTLS)](https://agentgateway.dev/docs/kubernetes/latest/setup/listeners/mtls.md): Add a FrontendTLSConfig to a Gateway to create a mutual TLS (mTLS) listener. About FrontendTLS When … - [TCP](https://agentgateway.dev/docs/kubernetes/latest/setup/listeners/tcp.md): The following guide deploys a sample TCP echo app, sets up a TCP listener on the gateway, and … - [Additional TLS settings](https://agentgateway.dev/docs/kubernetes/latest/setup/listeners/tls-settings.md): Use an AgentgatewayPolicy resource to configure additional TLS settings for your listeners, such as … #### Customize the gateway - [Customization options](https://agentgateway.dev/docs/kubernetes/latest/setup/customize/options.md): In the standalone agentgateway deployment, you can manage configuration via a YAML or JSON file. The … - [Customize the gateway](https://agentgateway.dev/docs/kubernetes/latest/setup/customize/customize.md): Customize your agentgateway proxy with the AgentgatewayParameters resource. Before you begin Set up … - [Example configs](https://agentgateway.dev/docs/kubernetes/latest/setup/customize/configs.md): Review common proxy customizations that you might want to apply in your environment. For steps on … ### LLM consumption - [About](https://agentgateway.dev/docs/kubernetes/latest/llm/about.md): Agentgateway provides seamless integration with various Large Language Model (LLM) providers. This … - [Model aliasing](https://agentgateway.dev/docs/kubernetes/latest/llm/alias.md): Configure global or provider-specific aliases for your models to refer to your model by using … - [API keys](https://agentgateway.dev/docs/kubernetes/latest/llm/api-keys.md): Managing API keys is an important security mechanism to prevent unauthorized access to your LLM … - [Virtual keys](https://agentgateway.dev/docs/kubernetes/latest/llm/virtual-keys.md): Issue API keys with per-key token budgets and cost tracking (also known as virtual keys). About … - [Load balancing](https://agentgateway.dev/docs/kubernetes/latest/llm/load-balancing.md): Distribute requests across multiple LLM providers automatically (also known as Power of Two Choices, … - [Model failover](https://agentgateway.dev/docs/kubernetes/latest/llm/failover.md): Prioritize the failover of requests across different models from an LLM provider. Include outlier … - [Content-based routing](https://agentgateway.dev/docs/kubernetes/latest/llm/content-routing.md): Route requests to different LLM backends based on request body content, such as the requested model … - [Streaming](https://agentgateway.dev/docs/kubernetes/latest/llm/streaming.md): Models return a response in two main ways: all at once in a single chunk, or in a stream of chunks. … - [OpenAI Realtime](https://agentgateway.dev/docs/kubernetes/latest/llm/realtime.md): Proxy OpenAI Realtime API traffic through agentgateway to get token usage tracking and observability … - [Function calling](https://agentgateway.dev/docs/kubernetes/latest/llm/functions.md): About function calling Large Language Models (LLMs) are limited by static training data. This … - [Prompt enrichment](https://agentgateway.dev/docs/kubernetes/latest/llm/prompt-enrichment.md): Effectively manage system and user prompts to improve LLM outputs. About prompt enrichment Prompts … - [Prompt templates](https://agentgateway.dev/docs/kubernetes/latest/llm/prompt-templates.md): Use prompt templates to inject dynamic context, user identity, or other runtime information into … - [Request transformations](https://agentgateway.dev/docs/kubernetes/latest/llm/transformations.md): Use LLM request transformations to dynamically compute and set fields in LLM requests using Common … - [Budget and spend limits](https://agentgateway.dev/docs/kubernetes/latest/llm/budget-limits.md): Advanced patterns for enforcing token budget limits per API key or user. About Budget limits (also … - [Rate limiting for LLMs](https://agentgateway.dev/docs/kubernetes/latest/llm/rate-limit.md): Control LLM costs with token-based rate limiting and request-based limits. About Rate limiting for … - [LLM cost tracking](https://agentgateway.dev/docs/kubernetes/latest/llm/cost-tracking.md): Track and monitor LLM costs per request using token usage metrics. About Cost tracking (also known … - [CEL-based RBAC](https://agentgateway.dev/docs/kubernetes/latest/llm/rbac.md): Use Common Language Expressions (CEL) expressions to secure access to AI resources. About CEL-based … - [Metrics and logs](https://agentgateway.dev/docs/kubernetes/latest/llm/observability.md): Review LLM-specific metrics and logs. To calculate costs from token usage metrics, see the cost … #### Providers - [Amazon Bedrock](https://agentgateway.dev/docs/kubernetes/latest/llm/providers/bedrock.md): Configure Amazon Bedrock as an LLM provider in agentgateway. Before you begin Set up an agentgateway … - [Anthropic](https://agentgateway.dev/docs/kubernetes/latest/llm/providers/anthropic.md): Configure Anthropic (Claude) as an LLM provider in agentgateway. Before you begin Install and set up … - [Azure](https://agentgateway.dev/docs/kubernetes/latest/llm/providers/azure.md): Configure Azure as an LLM provider in agentgateway. Azure supports two endpoint types: Azure OpenAI … - [Gemini](https://agentgateway.dev/docs/kubernetes/latest/llm/providers/gemini.md): Configure Google Gemini as an LLM provider in agentgateway. Before you begin Install and set up an … - [OpenAI](https://agentgateway.dev/docs/kubernetes/latest/llm/providers/openai.md): Configure OpenAI as an LLM provider in agentgateway. Don’t have an API key to an LLM provider? … - [OpenAI-compatible providers](https://agentgateway.dev/docs/kubernetes/latest/llm/providers/openai-compatible.md): Configure OpenAI-compatible LLM providers such as Mistral, DeepSeek, or any other provider that … - [Vertex AI](https://agentgateway.dev/docs/kubernetes/latest/llm/providers/vertex.md): Configure Vertex AI as an LLM provider in agentgateway. Before you begin Install and set up an … - [Ollama](https://agentgateway.dev/docs/kubernetes/latest/llm/providers/ollama.md): Configure Ollama to serve local models through agentgateway. Ollama runs on a machine outside your … - [vLLM](https://agentgateway.dev/docs/kubernetes/latest/llm/providers/vllm.md): Configure vLLM, a high-performance LLM serving engine, through agentgateway. This guide covers two … - [Multiple endpoints](https://agentgateway.dev/docs/kubernetes/latest/llm/providers/multiple-endpoints.md): Configure access to multiple OpenAI API endpoints such as for chat completions, embeddings, and … - [Mock LLM with httpbun](https://agentgateway.dev/docs/kubernetes/latest/llm/providers/httpbun.md): Install httpbun for a mock LLM API endpoint that is compatible with the OpenAI API for chat … #### Guardrails - [About guardrails](https://agentgateway.dev/docs/kubernetes/latest/llm/guardrails/overview.md): Protect LLM requests and responses from sensitive data exposure and harmful content using layered … - [Regex filters](https://agentgateway.dev/docs/kubernetes/latest/llm/guardrails/regex.md): Use custom regex patterns and built-in PII detectors to filter LLM requests and responses. About … - [OpenAI moderation](https://agentgateway.dev/docs/kubernetes/latest/llm/guardrails/moderation.md): The OpenAI Moderation API detects potentially harmful content across categories including hate, … - [AWS Bedrock Guardrails](https://agentgateway.dev/docs/kubernetes/latest/llm/guardrails/bedrock-guardrails.md): AWS Bedrock Guardrails provide content filtering, PII detection, topic restrictions, and word … - [Google Model Armor](https://agentgateway.dev/docs/kubernetes/latest/llm/guardrails/google-model-armor.md): Google Cloud Model Armor lets you create safety templates in the Google Cloud console and apply them … - [Multi-layered guardrails](https://agentgateway.dev/docs/kubernetes/latest/llm/guardrails/multi-layer.md): You can configure multiple prompt guards that run in sequence, creating defense-in-depth protection. … ##### Custom webhooks - [Guardrail webhook guide](https://agentgateway.dev/docs/kubernetes/latest/llm/guardrails/webhook/guardrails.md): Use the Guardrail Webhook API to set up your own custom guardrail controls for agentgateway. About … - [Webhook API reference](https://agentgateway.dev/docs/kubernetes/latest/llm/guardrails/webhook/openapi-spec.md): Review the OpenAPI reference docs for the Guardrail Webhook API for agentgateway. GuardRail Webhook … ### Tutorials #### LLM gateway #### Basic MCP server #### MCP federation #### JWT authorization #### Telemetry & observability #### Azure AI Foundry #### Prompt enrichment #### Claude Code CLI proxy ### MCP connectivity - [About](https://agentgateway.dev/docs/kubernetes/latest/mcp/about.md): Learn more about MCP and common challenges when adopting MCP in enterprise environments. About MCP … - [Static MCP](https://agentgateway.dev/docs/kubernetes/latest/mcp/static-mcp.md): Route to a Model Context Protocol (MCP) server through a static address. For more information, see … - [Dynamic MCP](https://agentgateway.dev/docs/kubernetes/latest/mcp/dynamic-mcp.md): Route to a Model Context Protocol (MCP) server dynamically by using a label selector. This way, … - [Virtual MCP](https://agentgateway.dev/docs/kubernetes/latest/mcp/virtual.md): To federate multiple MCP servers on the same gateway, you can use a label selector in the MCP … - [Connect via HTTPS](https://agentgateway.dev/docs/kubernetes/latest/mcp/https.md): Configure your agentgateway proxy to connect to an MCP server by using the HTTPS protocol. About … - [JWT auth for services](https://agentgateway.dev/docs/kubernetes/latest/mcp/mcp-access.md): Control access or route traffic based on verified claims in a JSON web token (JWT). This guide shows … - [Tool access](https://agentgateway.dev/docs/kubernetes/latest/mcp/tool-access.md): Control access or route traffic based on verified claims in a JSON web token (JWT). About tool … - [Rate limiting for MCP](https://agentgateway.dev/docs/kubernetes/latest/mcp/rate-limit.md): Control MCP tool call rates to prevent overload and ensure fair access to expensive tools. About … - [Stateful MCP](https://agentgateway.dev/docs/kubernetes/latest/mcp/session.md): Configure stateful or stateless session routing to MCP backends. About MCP sessions An MCP session … #### MCP auth - [About MCP auth](https://agentgateway.dev/docs/kubernetes/latest/mcp/auth/about.md): MCP authentication ensures that only authorized MCP clients can access MCP servers and the tools … - [Set up Keycloak](https://agentgateway.dev/docs/kubernetes/latest/mcp/auth/keycloak.md): Set up Keycloak in your cluster as your OAuth identity provider. Then, configure your agentgateway … - [Set up MCP auth](https://agentgateway.dev/docs/kubernetes/latest/mcp/auth/setup.md): Secure your Model Context Protocol (MCP) servers with OAuth 2.0 authentication by using agentgateway … ### Agent connectivity - [About](https://agentgateway.dev/docs/kubernetes/latest/agent/about.md): Learn about what agents are and how they work. About A2A Agent-to-agent, or A2A, is an open protocol … - [Connect to an agent](https://agentgateway.dev/docs/kubernetes/latest/agent/a2a.md): With agentgateway, you can route to agent-to-agent (A2A) servers and expose their tools securely. … ### Traffic management - [Buffering](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/buffering.md): Fine-tune connection speeds for read and write operations by setting a connection buffer limit. … - [Direct responses](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/direct-response.md): Use the directResponse API to directly respond to incoming requests without forwarding them to … - [Dynamic Forward Proxy (DFP)](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/dfp.md): Dynamically resolve upstream hosts at request time. About Dynamic Forward Proxy Dynamic Forward … - [External processing (ExtProc)](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/extproc.md): Modify aspects of an HTTP request or response with an external processing server. About external … - [gRPC routing](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/grpc.md): Route traffic to gRPC services by using the GRPCRoute resource for protocol-aware routing. About … - [Traffic splitting](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/traffic-split.md): Set up weight-based routing between multiple apps for A/B testing, traffic splitting, and canary … #### Header control - [Request headers](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/header-control/request-header.md): Use the RequestHeaderModifier filter to add, append, overwrite, or remove request headers for a … - [Response headers](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/header-control/response-header.md): Use the ResponseHeaderModifier filter to add, append, overwrite, or remove headers from a response … - [Early request header modification](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/header-control/early-request-header-modifier.md): Early request header modification allows you to add, set, or remove HTTP request headers at the … #### Matching - [Header](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/match/header.md): Specify a set of headers which incoming requests must match in entirety, such as with regular … - [Host](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/match/host.md): Expose a route on multiple hosts. For more information, see the Kubernetes Gateway API … - [HTTP method](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/match/method.md): Specify an HTTP method, such as POST, GET, PUT, PATCH, or DELETE, to match requests against. For … - [Path](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/match/path.md): Match the targeted path of an incoming request against specific path criteria. For more information, … - [Query parameter](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/match/query.md): Specify a set of URL query parameters which requests must match in entirety. For more information, … #### Redirects - [HTTPS redirect](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/redirect/https.md): Redirect HTTP traffic to HTTPS. For more information, see the Kubernetes Gateway API documentation. … - [Host redirect](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/redirect/host.md): Redirect requests to a different host. For more information, see the Kubernetes Gateway API … - [Path redirects](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/redirect/path.md): Redirect requests to a different path prefix. For more information, see the Kubernetes Gateway API … #### Rewrites - [Host rewrites](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/rewrite/host.md): Replace the host header value before forwarding a request to a backend service by using the … - [Path rewrites](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/rewrite/path.md): Rewrite path prefixes in requests by using the URLRewrite filter. For more information, see the … #### Transformations - [Templating language](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/templating-language.md): Agentgateway transformation templates are written in Common Expression Language (CEL). CEL is a … - [Inject response headers](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/inject-response-headers.md): Use CEL expressions to inject, modify, and remove response headers. The example uses the … - [Generate request tracing headers](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/tracing.md): Use the uuid() and random() CEL functions to inject dynamically generated values into request … - [Encode base64 headers](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/encode.md): Use CEL expressions to encode and decode base64 values in request headers and add the results as … - [Rewrite dynamic path segments](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/rewrite.md): Use the with() and regexReplace() CEL functions together with request.path to rewrite dynamic path … - [Forward request URLs](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/forward.md): Use CEL expressions to construct a full request URL from context variables and forward it upstream … - [Change request path and method](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/path-method.md): Change the request path and HTTP method when a request header is present by using CEL expressions. … - [Promote query parameters to request headers](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/query.md): Promote a query parameter to a request header by using CEL expressions. The example uses request.uri … - [Inject LLM model headers](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/llm-model-headers.md): Use LLM request transformations to dynamically compute and set fields in LLM requests using Common … - [Remove headers](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/remove-header.md): Remove headers from requests before they reach the upstream. Use this when a client sends headers … - [Inject response bodies](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/inject-response-body.md): Learn how to return a customized response body by using CEL expressions. The examples use … - [Change response bodies](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/status.md): Update the response status based on request query parameters by using CEL expressions. The example … - [Filter and merge request body fields](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/filter-request-body.md): Use the filterKeys() and merge() CEL functions together with json() and toJson() to sanitize a JSON … - [Validate and set request body defaults](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/validate.md): Use the default() and fail() CEL functions with json(), merge(), and toJson() to control what … - [Enrich access logs](https://agentgateway.dev/docs/kubernetes/latest/traffic-management/transformations/access-logs.md): When building or debugging transformations, you can log CEL variables to inspect what values are … ### Resiliency - [HTTP connection settings](https://agentgateway.dev/docs/kubernetes/latest/resiliency/connection.md): You can use an AgentgatewayPolicy to apply HTTP connection settings to the agentgateway proxy. These … - [Keepalive](https://agentgateway.dev/docs/kubernetes/latest/resiliency/keepalive.md): Manage idle and stale connections with TCP and HTTP keepalive. About keepalive With keepalive, the … #### Retries - [About](https://agentgateway.dev/docs/kubernetes/latest/resiliency/retry/about.md): A retry is the number of times a request is retried if it fails. This setting can be useful to avoid … - [Request retries](https://agentgateway.dev/docs/kubernetes/latest/resiliency/retry/retry.md): Specify the number of times and duration for the gateway to try a connection to an unresponsive … - [Per-try timeout](https://agentgateway.dev/docs/kubernetes/latest/resiliency/retry/per-try-timeout.md): Set separate timeouts for retries. This feature is experimental in the upstream Kubernetes Gateway … #### Timeouts - [About timeouts](https://agentgateway.dev/docs/kubernetes/latest/resiliency/timeouts/about.md): A timeout is the amount of time (duration) that the gateway waits for replies from a backend service … - [Request timeouts](https://agentgateway.dev/docs/kubernetes/latest/resiliency/timeouts/request.md): Set the route-level timeout with an HTTPRoute or AgentgatewayPolicy. To ensure that your apps are … - [Idle timeouts](https://agentgateway.dev/docs/kubernetes/latest/resiliency/timeouts/idle.md): Set an idle timeout for HTTP/1 traffic to terminate the connection to a downstream or upstream … - [Per-try timeouts](https://agentgateway.dev/docs/kubernetes/latest/resiliency/timeouts/per-try-timeout.md): Per-try timeouts ### Security - [Access logging](https://agentgateway.dev/docs/kubernetes/latest/security/access-logging.md): Capture an access log for all the requests that enter the proxy. About access logging Access logs, … - [BackendTLS](https://agentgateway.dev/docs/kubernetes/latest/security/backendtls.md): Originate a one-way TLS connection from the Gateway to a backend. This feature is experimental in … - [CORS](https://agentgateway.dev/docs/kubernetes/latest/security/cors.md): Enforce client-site access controls with cross-origin resource sharing (CORS). This feature is … - [CSRF](https://agentgateway.dev/docs/kubernetes/latest/security/csrf.md): Protect your web apps from Cross-Site Request Forgery (CSRF) attacks by configuring origin … - [Local rate limiting](https://agentgateway.dev/docs/kubernetes/latest/security/rate-limit-http.md): Apply local and global rate limits to HTTP traffic to protect your backend services from overload. … - [Global rate limiting](https://agentgateway.dev/docs/kubernetes/latest/security/rate-limit-global.md): Apply distributed rate limits across multiple agentgateway replicas using an external rate limit … #### External auth - [API key auth](https://agentgateway.dev/docs/kubernetes/latest/security/extauth/apikey.md): API keys are secure, long-lived UUIDs that clients provide when they send a request to your service. … - [Basic auth](https://agentgateway.dev/docs/kubernetes/latest/security/extauth/basic.md): Basic authentication sends encoded user credentials in a standard header within the request. The … - [BYO ext auth service](https://agentgateway.dev/docs/kubernetes/latest/security/extauth/byo-ext-auth-service.md): Bring your own external authorization service to protect requests that go through your Gateway. … #### JWT auth - [About JWT auth](https://agentgateway.dev/docs/kubernetes/latest/security/jwt/about.md): A JSON Web Token (JWT) is an open standard for securely sharing information between a client and … - [JWT auth](https://agentgateway.dev/docs/kubernetes/latest/security/jwt/setup.md): Secure your applications with JSON Web Token (JWT) authentication by using the agentgateway proxy … - [JWT auth for MCP services](https://agentgateway.dev/docs/kubernetes/latest/security/jwt/mcp.md): Redirecting to /docs/kubernetes/latest/mcp/mcp-access/... ### Integrations - [Argo Rollouts](https://agentgateway.dev/docs/kubernetes/latest/integrations/argo.md): Argo Rollouts is a Kubernetes controller that provides advanced deployment capabilities such as … #### LLM client configuration - [Claude Code](https://agentgateway.dev/docs/kubernetes/latest/integrations/llm-clients/claude-code.md): Configure Claude Code, the AI coding CLI by Anthropic, to route LLM requests through your … - [Cursor](https://agentgateway.dev/docs/kubernetes/latest/integrations/llm-clients/cursor.md): Configure Cursor, the AI code editor, to route requests to your LLM through your agentgateway proxy. … - [Windsurf](https://agentgateway.dev/docs/kubernetes/latest/integrations/llm-clients/windsurf.md): Configure Windsurf, the AI code editor by Codeium, to route requests to your LLM through your … - [VS Code Continue](https://agentgateway.dev/docs/kubernetes/latest/integrations/llm-clients/continue.md): Configure Continue, the open-source AI code assistant for VS Code, to use agentgateway deployed in … - [GitHub Copilot](https://agentgateway.dev/docs/kubernetes/latest/integrations/llm-clients/github-copilot.md): Configure GitHub Copilot in VS Code to use agentgateway deployed in Kubernetes. Custom endpoint … - [OpenAI SDK](https://agentgateway.dev/docs/kubernetes/latest/integrations/llm-clients/openai-sdk.md): Use the OpenAI Python or Node.js SDK to send requests through agentgateway deployed in Kubernetes. … - [curl](https://agentgateway.dev/docs/kubernetes/latest/integrations/llm-clients/curl.md): Test your agentgateway Kubernetes deployment using curl. Before you begin Set up an agentgateway … #### LLM observability - [Langfuse](https://agentgateway.dev/docs/kubernetes/latest/integrations/llm-observability/langfuse.md): Langfuse is an open-source LLM observability platform that provides prompt management, analytics, … - [LangSmith](https://agentgateway.dev/docs/kubernetes/latest/integrations/llm-observability/langsmith.md): LangSmith is LangChain’s platform for debugging, testing, evaluating, and monitoring LLM … #### MCP clients ### Observability - [Admin UI](https://agentgateway.dev/docs/kubernetes/latest/observability/ui.md): Use the agentgateway Admin UI to inspect your Kubernetes proxy configuration. About The agentgateway … - [OTel stack](https://agentgateway.dev/docs/kubernetes/latest/observability/otel-stack.md): Deploy an open source observability stack based on OpenTelemetry (OTel) that includes the following … - [Control plane metrics](https://agentgateway.dev/docs/kubernetes/latest/observability/control-plane-metrics.md): By default, the agentgateway control plane exposes metrics in Prometheus format. You can use these … - [Monitoring agentgateway proxies for NACKs](https://agentgateway.dev/docs/kubernetes/latest/observability/nacks.md): About NACKs A NACK (negative acknowledgement) occurs when an agentgateway proxy rejects a … - [Tracing](https://agentgateway.dev/docs/kubernetes/latest/observability/tracing.md): Integrate your agentgateway proxy with an OpenTelemetry (OTel) collector and configure custom … ### Operations - [Debug your setup](https://agentgateway.dev/docs/kubernetes/latest/operations/debug.md): Use built-in tools to troubleshoot issues in your agentgateway setup. Kgateway consists of the … - [Upgrade](https://agentgateway.dev/docs/kubernetes/latest/operations/upgrade.md): You can use this guide to upgrade the agentgateway control plane and data plane components, or to … - [Uninstall](https://agentgateway.dev/docs/kubernetes/latest/operations/uninstall.md): If you no longer need your agentgateway environment, you can uninstall the control plane and all … ### Migrate from Ingress #### Install ##### macOS installation ##### Linux installation ##### Windows installation #### Emitters ##### Agentgateway #### Providers ##### Ingress NGINX #### Examples - [Basic Ingress](https://agentgateway.dev/docs/kubernetes/latest/migrate/examples/basic.md): This example shows the simplest case: an Ingress with no special annotations. The tool converts it … - [Rate Limiting](https://agentgateway.dev/docs/kubernetes/latest/migrate/examples/rate-limiting.md): NGINX’s limit-rps, limit-rpm, and limit-burst-multiplier annotations are projected by the … - [CORS](https://agentgateway.dev/docs/kubernetes/latest/migrate/examples/cors.md): CORS annotations on an Ingress are projected by the agentgateway emitter into an AgentgatewayPolicy … - [SSL Redirect](https://agentgateway.dev/docs/kubernetes/latest/migrate/examples/ssl-redirect.md): The ssl-redirect annotation tells NGINX to redirect HTTP to HTTPS. In Gateway API, this becomes a … - [External Auth](https://agentgateway.dev/docs/kubernetes/latest/migrate/examples/external-auth.md): If you use NGINX’s auth-url to call an in-cluster authentication service, the agentgateway … - [Canary Deployments](https://agentgateway.dev/docs/kubernetes/latest/migrate/examples/canary.md): NGINX’s canary annotations let you split traffic between versions. The tool merges these into … - [Backend TLS](https://agentgateway.dev/docs/kubernetes/latest/migrate/examples/backend-tls.md): When your backend requires TLS (re-encryption or mTLS), NGINX’s proxy-ssl-* annotations are … #### Reference ##### CLI ### Reference - [API reference](https://agentgateway.dev/docs/kubernetes/latest/reference/api.md): Review the API reference documentation for agentgateway on Kubernetes. Looking for the standalone … - [CEL expressions](https://agentgateway.dev/docs/kubernetes/latest/reference/cel.md): Agentgateway uses the CEL (Common Expression Language)CEL (Common Expression Language)A simple … - [Release notes](https://agentgateway.dev/docs/kubernetes/latest/reference/release-notes.md): Review the release notes for agentgateway. For more details, review the GitHub release notes in the … - [Version support](https://agentgateway.dev/docs/kubernetes/latest/reference/versions.md): Review the following information about supported release versions for the agentgateway project. … #### Helm value reference - [agentgateway](https://agentgateway.dev/docs/kubernetes/latest/reference/helm/agentgateway.md): Review Helm values for the agentgateway Helm chart. For more information about using this Helm … - [agentgateway-crds](https://agentgateway.dev/docs/kubernetes/latest/reference/helm/agentgateway-crds..md): Review Helm values for the agentgateway-crds Helm chart. This Helm chart controls whether specific … ## Standalone binary docs - [FAQs](https://agentgateway.dev/docs/standalone/latest/faqs.md): Check out frequently asked questions about agentgateway. What are MCP and A2A? With agentic … ### Get started - [LLM (OpenAI)](https://agentgateway.dev/docs/standalone/latest/quickstart/llm.md): Configure the agentgateway binary to route requests to the OpenAI chat completions API. Before you … - [MCP servers](https://agentgateway.dev/docs/standalone/latest/quickstart/mcp.md): Use the agentgateway binary to proxy requests to an open source MCP test server, server-everything. … - [Non-agentic HTTP traffic](https://agentgateway.dev/docs/standalone/latest/quickstart/non-agentic-http.md): Use the agentgateway binary to route HTTP traffic to a simple backend (httpbin) running locally. … ### About - [Introduction](https://agentgateway.dev/docs/standalone/latest/about/introduction.md): Agentgateway is an open source gateway control plane and proxy data plane, hosted as part of the … - [Architecture](https://agentgateway.dev/docs/standalone/latest/about/architecture.md): The following figure shows how agentgateway provides AI connectivity for agents, tools, and LLMs in … ### Deployment #### Deploy the binary #### Deploy with Docker #### Deploy on Kubernetes ### Configuration - [Overview](https://agentgateway.dev/docs/standalone/latest/configuration/overview.md): Manage agentgateway through a configuration file. Supported file formats are JSON and YAML. … - [Static configuration](https://agentgateway.dev/docs/standalone/latest/configuration/static-configuration.md): Most agentgateway configurations dynamically update as you make changes to the binds, policies, … - [Policies](https://agentgateway.dev/docs/standalone/latest/configuration/policies.md): PoliciesPolicyA configuration that manipulates, secures, or observes traffic as it flows through … - [Listeners](https://agentgateway.dev/docs/standalone/latest/configuration/listeners.md): Listeners are the entrypoints for traffic into agentgateway. Agentgateway supports both HTTPHTTP … - [Backends](https://agentgateway.dev/docs/standalone/latest/configuration/backends.md): Agentgateway backendsBackendA destination service that receives traffic from agentgateway. Backends … - [Routes](https://agentgateway.dev/docs/standalone/latest/configuration/routes.md): RoutesRouteA rule that matches incoming requests and forwards them to backends. Routes can match on … #### Traffic management - [Request matching](https://agentgateway.dev/docs/standalone/latest/configuration/traffic-management/matching.md): Based on the route schema, you can configure the following matchingMatchingThe process of … - [Header manipulation](https://agentgateway.dev/docs/standalone/latest/configuration/traffic-management/manipulation.md): Attaches to: Route Backend There are a few different policies that offer manipulation of HTTP … - [Redirects](https://agentgateway.dev/docs/standalone/latest/configuration/traffic-management/redirects.md): Attaches to: Route Backend Request redirectsRedirectA traffic management feature that sends clients … - [Transformations](https://agentgateway.dev/docs/standalone/latest/configuration/traffic-management/transformations.md): Attaches to: Listener Route Agentgateway uses transformationTransformationThe process of modifying … - [Rewrites](https://agentgateway.dev/docs/standalone/latest/configuration/traffic-management/rewrites.md): Attaches to: Route Modify URLs of incoming requests with rewriteRewriteA traffic management feature … - [Direct Response](https://agentgateway.dev/docs/standalone/latest/configuration/traffic-management/direct-response.md): Attaches to: Route Directly respond to a request with a custom response using direct responseDirect … - [External processing (ExtProc)](https://agentgateway.dev/docs/standalone/latest/configuration/traffic-management/extproc.md): Attaches to: Listener Route External processingExtProc (External Processing)An advanced filter that … - [AI (LLM) Policies](https://agentgateway.dev/docs/standalone/latest/configuration/traffic-management/llm.md): Attaches to: Backend (AI Backends only) Agentgateway has a number of policies that can be used to … #### Resiliency - [Mirroring](https://agentgateway.dev/docs/standalone/latest/configuration/resiliency/mirroring.md): Attaches to: Route Backend Request mirroringMirroringA resiliency feature that sends a copy of … - [Rate limiting](https://agentgateway.dev/docs/standalone/latest/configuration/resiliency/rate-limits.md): Attaches to: Route Use rate limiting to enforce budget and spend limits per key: control the rate of … - [Retries](https://agentgateway.dev/docs/standalone/latest/configuration/resiliency/retries.md): Attaches to: Route When a backend request fails, agentgateway can be configured to retryRetryA … - [Timeouts](https://agentgateway.dev/docs/standalone/latest/configuration/resiliency/timeouts.md): Attaches to: Route Backend Request timeoutsTimeoutA time limit for how long agentgateway will wait … #### Security - [Backend authentication](https://agentgateway.dev/docs/standalone/latest/configuration/security/backend-authn.md): Attaches to: Backend When connecting to a backend, an authentication token can be attached to each … - [Backend TLS](https://agentgateway.dev/docs/standalone/latest/configuration/security/backend-tls.md): Attaches to: Backend By default, requests to backends use HTTP. To use HTTPS, configure a backend … - [CORS](https://agentgateway.dev/docs/standalone/latest/configuration/security/cors.md): Attaches to: Route About CORS Cross-origin resource sharing (CORS)CORS (Cross-Origin Resource … - [CSRF](https://agentgateway.dev/docs/standalone/latest/configuration/security/csrf.md): Attaches to: Route About CSRF protection According to OWASP, CSRF is defined as follows: Cross-Site … - [HTTP authorization](https://agentgateway.dev/docs/standalone/latest/configuration/security/http-authz.md): Attaches to: Route HTTP authorizationAuthorization (AuthZ)The process of determining what actions an … - [Network authorization](https://agentgateway.dev/docs/standalone/latest/configuration/security/network-authz.md): Attaches to: Frontend Network authorization enforces access control at the L4 (transport) level, … - [JWT authentication](https://agentgateway.dev/docs/standalone/latest/configuration/security/jwt-authn.md): Attaches to: Listener Route JWT tokensJWT (JSON Web Token)A compact, URL-safe token format used for … - [Basic authentication](https://agentgateway.dev/docs/standalone/latest/configuration/security/basic-authn.md): Attaches to: Listener Route Basic authentication enables a simple username/password authentication … - [API Key authentication](https://agentgateway.dev/docs/standalone/latest/configuration/security/apikey-authn.md): Attaches to: Listener Route API keyAPI KeyA secret token used to authenticate API requests. … - [External authorization](https://agentgateway.dev/docs/standalone/latest/configuration/security/external-authz.md): Attaches to: Listener Route When authorizationAuthorization (AuthZ)The process of determining what … - [MCP authentication](https://agentgateway.dev/docs/standalone/latest/configuration/security/mcp-authn.md): Attaches to: Route MCP authentication enables OAuth 2.0 protection for MCP servers, helping to … - [MCP authorization](https://agentgateway.dev/docs/standalone/latest/configuration/security/mcp-authz.md): Attaches to: Backend (MCP Backends only) The MCP authorizationAuthorization (AuthZ)The process of … - [OIDC browser authentication](https://agentgateway.dev/docs/standalone/latest/configuration/security/oidc.md): Attaches to: Route OIDC browser authentication provides built-in OpenID Connect login for … ### Tutorials #### Basic MCP server #### LLM gateway #### Multiplex MCP servers #### MCP federation #### Agent-to-Agent #### JWT authorization #### OpenAPI to MCP #### Telemetry & observability #### TLS / HTTPS #### MCP authentication #### OAuth2 proxy integration #### Tailscale authentication #### HTTP routing & policies ### LLM consumption - [About](https://agentgateway.dev/docs/standalone/latest/llm/about.md): Agentgateway provides seamless integration with various Large Language Model (LLM) providers. This … - [Virtual key management](https://agentgateway.dev/docs/standalone/latest/llm/virtual-keys.md): Issue API keys to users or applications and control token usage (also known as virtual keys). About … - [Manage API keys](https://agentgateway.dev/docs/standalone/latest/llm/api-keys.md): Managing API keys is an important security mechanism to prevent unauthorized access to your LLM … - [Content-based routing](https://agentgateway.dev/docs/standalone/latest/llm/content-routing.md): Route requests to different LLM backends based on the content of the request body, not just headers … - [Control spend](https://agentgateway.dev/docs/standalone/latest/llm/spending.md): Control cost by limiting the number of tokens that can be used and preventing LLM misuse. Use token … - [OpenAI Realtime](https://agentgateway.dev/docs/standalone/latest/llm/realtime.md): Proxy OpenAI Realtime API traffic through agentgateway to get token usage tracking and observability … - [Prompt templates](https://agentgateway.dev/docs/standalone/latest/llm/prompt-templates.md): Use model-level transformations to dynamically customize LLM request parameters based on request … - [Transform requests](https://agentgateway.dev/docs/standalone/latest/llm/transformations.md): Use LLM request transformations to dynamically compute and set fields in LLM requests using Common … - [Observe traffic](https://agentgateway.dev/docs/standalone/latest/llm/observability.md): Get prompt logging, cost tracking, and a full audit trail: review LLM-specific metrics, logs, and … - [Routing-based configuration for LLMs](https://agentgateway.dev/docs/standalone/latest/llm/configuration-modes.md): Agentgateway offers two ways to configure LLM providers, each optimized for different use cases. … #### Providers - [OpenAI](https://agentgateway.dev/docs/standalone/latest/llm/providers/openai.md): Configure OpenAI as an LLM provider in agentgateway. Configuration Review the following example … - [OpenAI-compatible providers](https://agentgateway.dev/docs/standalone/latest/llm/providers/openai-compatible.md): Configure any LLM provider that implements the OpenAI API format with agentgateway. Use the openAI … - [Ollama](https://agentgateway.dev/docs/standalone/latest/llm/providers/ollama.md): Configure Ollama to serve local models through agentgateway. Ollama runs models locally on your … - [Vertex AI](https://agentgateway.dev/docs/standalone/latest/llm/providers/vertex.md): Configure Google Cloud Vertex AI as an LLM provider in agentgateway. Authentication Before you can … - [Gemini](https://agentgateway.dev/docs/standalone/latest/llm/providers/gemini.md): Configure Google Gemini as an LLM provider in agentgateway. Configuration Review the following … - [Amazon Bedrock](https://agentgateway.dev/docs/standalone/latest/llm/providers/bedrock.md): Configure Amazon Bedrock as an LLM provider in agentgateway. Authentication Before you can use … - [Multiple LLM providers](https://agentgateway.dev/docs/standalone/latest/llm/providers/multiple-llms.md): Create a group of LLM providers for the same route. Then, agentgateway automatically load balances … - [Anthropic](https://agentgateway.dev/docs/standalone/latest/llm/providers/anthropic.md): Configure Anthropic (Claude models) as an LLM provider in agentgateway. Configuration Review the … - [Azure](https://agentgateway.dev/docs/standalone/latest/llm/providers/azure.md): Configure Microsoft Azure AI as an LLM provider in agentgateway. Authentication Before you can use … #### Guardrails - [About guardrails](https://agentgateway.dev/docs/standalone/latest/llm/prompt-guards/overview.md): Protect LLM requests and responses from sensitive data exposure and harmful content using layered … - [Regex filters](https://agentgateway.dev/docs/standalone/latest/llm/prompt-guards/regex.md): Use custom regex patterns and built-in PII detectors to filter LLM requests and responses. About … - [OpenAI moderation](https://agentgateway.dev/docs/standalone/latest/llm/prompt-guards/moderation.md): The OpenAI Moderation API detects potentially harmful content across categories including hate, … - [AWS Bedrock Guardrails](https://agentgateway.dev/docs/standalone/latest/llm/prompt-guards/bedrock-guardrails.md): AWS Bedrock Guardrails let you define content policies in the AWS console and apply them to LLM … - [Google Model Armor](https://agentgateway.dev/docs/standalone/latest/llm/prompt-guards/google-model-armor.md): Google Cloud Model Armor lets you create safety templates in the Google Cloud console and apply them … - [Custom webhooks](https://agentgateway.dev/docs/standalone/latest/llm/prompt-guards/webhooks.md): For advanced content safety requirements beyond regex and cloud provider services, you can integrate … - [Multi-layered guardrails](https://agentgateway.dev/docs/standalone/latest/llm/prompt-guards/multi-layer.md): You can configure multiple prompt guards that run in sequence, creating defense-in-depth protection. … ### Inference routing ### MCP connectivity - [About](https://agentgateway.dev/docs/standalone/latest/mcp/about.md): Learn more about MCP and common challenges when adopting MCP in enterprise environments. About MCP … - [MCP authentication](https://agentgateway.dev/docs/standalone/latest/mcp/mcp-authn.md): Note This policy works only for MCP traffic. Note that all standard HTTP policies also apply to MCP … - [MCP authorization](https://agentgateway.dev/docs/standalone/latest/mcp/mcp-authz.md): Note This policy works only for MCP traffic. Note that all standard HTTP policies also apply to MCP … - [MCP target policies](https://agentgateway.dev/docs/standalone/latest/mcp/mcp-target-policies.md): Apply policies at the MCP target level to control behavior for individual MCP servers within a … - [MCP observability](https://agentgateway.dev/docs/standalone/latest/mcp/mcp-observability.md): Review MCP-specific metrics, logs, and traces. Before you begin Complete an MCP guide, such as the … #### Connect to MCP servers - [Stdio](https://agentgateway.dev/docs/standalone/latest/mcp/connect/stdio.md): An MCP backend allows exposing MCP servers through the agentgateway using STDIOSTDIO (Standard … - [Streamable HTTP](https://agentgateway.dev/docs/standalone/latest/mcp/connect/http.md): Connect to an MCP server via streamable HTTP. Want to use agentgateway in a Kubernetes environment … - [Virtual MCP](https://agentgateway.dev/docs/standalone/latest/mcp/connect/virtual.md): Federate tools of multiple MCP servers on the agentgateway by using MCP multiplexingMultiplexA … - [OpenAPI](https://agentgateway.dev/docs/standalone/latest/mcp/connect/openapi.md): Expose an OpenAPIOpenAPIA specification for describing RESTful APIs. Agentgateway can connect to MCP … ### Agent connectivity - [About](https://agentgateway.dev/docs/standalone/latest/agent/about.md): About A2A Agent-to-agent, or A2A, is an open protocol that enables communication and … - [Connect to an agent](https://agentgateway.dev/docs/standalone/latest/agent/a2a.md): Proxy requests to an agent that communicates via the agent-to-agent protocol (A2A). Want to use … ### Integrations #### Web UIs & agent frameworks - [Kagent](https://agentgateway.dev/docs/standalone/latest/integrations/web-uis/kagent.md): Kagent is a Kubernetes-native AI agent framework that brings autonomous agents to cloud-native … #### LLM clients - [Claude Code](https://agentgateway.dev/docs/standalone/latest/integrations/llm-clients/claude-code.md): Configure Claude Code, the AI coding CLI by Anthropic, to route LLM requests through your … - [Cursor](https://agentgateway.dev/docs/standalone/latest/integrations/llm-clients/cursor.md): Configure Cursor, the AI code editor, to route requests to your LLM through your agentgateway proxy. … - [Windsurf](https://agentgateway.dev/docs/standalone/latest/integrations/llm-clients/windsurf.md): Configure Windsurf, the AI code editor by Codeium, to route requests to your LLM through your … - [VS Code Continue](https://agentgateway.dev/docs/standalone/latest/integrations/llm-clients/continue.md): Configure Continue, the open-source AI code assistant for VS Code, to route requests through … - [GitHub Copilot](https://agentgateway.dev/docs/standalone/latest/integrations/llm-clients/github-copilot.md): Configure GitHub Copilot in VS Code to route requests through agentgateway. Custom endpoint … - [OpenAI SDK](https://agentgateway.dev/docs/standalone/latest/integrations/llm-clients/openai-sdk.md): Use the OpenAI Python or Node.js SDK to send requests through agentgateway. Before you begin Install … - [curl](https://agentgateway.dev/docs/standalone/latest/integrations/llm-clients/curl.md): Test and interact with agentgateway using curl. Before you begin Install the agentgateway binary. … #### LLM providers - [OpenAI](https://agentgateway.dev/docs/standalone/latest/integrations/llm-providers/openai.md): Redirecting to /docs/standalone/latest/llm/providers/openai/... - [Anthropic](https://agentgateway.dev/docs/standalone/latest/integrations/llm-providers/anthropic.md): Redirecting to /docs/standalone/latest/llm/providers/anthropic/... - [Azure OpenAI](https://agentgateway.dev/docs/standalone/latest/integrations/llm-providers/azure-openai.md): Redirecting to /docs/standalone/latest/llm/providers/azure/... - [Amazon Bedrock](https://agentgateway.dev/docs/standalone/latest/integrations/llm-providers/bedrock.md): Redirecting to /docs/standalone/latest/llm/providers/bedrock/... - [Google Gemini](https://agentgateway.dev/docs/standalone/latest/integrations/llm-providers/gemini.md): Redirecting to /docs/standalone/latest/llm/providers/gemini/... - [Vertex AI](https://agentgateway.dev/docs/standalone/latest/integrations/llm-providers/vertex.md): Redirecting to /docs/standalone/latest/llm/providers/vertex/... - [OpenAI-Compatible Providers](https://agentgateway.dev/docs/standalone/latest/integrations/llm-providers/openai-compatible.md): Redirecting to /docs/standalone/latest/llm/providers/openai-compatible/... - [xAI (Grok)](https://agentgateway.dev/docs/standalone/latest/integrations/llm-providers/xai.md): Redirecting to /docs/standalone/latest/llm/providers/openai-compatible/... #### MCP clients - [Claude](https://agentgateway.dev/docs/standalone/latest/integrations/mcp-clients/claude.md): Configure Anthropic’s Claude Desktop app or Claude Code CLI to use agentgateway as an MCP … - [Cursor](https://agentgateway.dev/docs/standalone/latest/integrations/mcp-clients/cursor.md): Configure Cursor, the AI-powered code editor, to use agentgateway as an MCP server. Before you begin … - [OpenCode](https://agentgateway.dev/docs/standalone/latest/integrations/mcp-clients/opencode.md): Configure OpenCode, the open source AI coding assistant, to use agentgateway as an MCP server. … - [Windsurf](https://agentgateway.dev/docs/standalone/latest/integrations/mcp-clients/windsurf.md): Configure Windsurf, Codeium’s AI-powered IDE, to use agentgateway as an MCP server. Before you … - [VS Code](https://agentgateway.dev/docs/standalone/latest/integrations/mcp-clients/vscode.md): Configure Visual Studio Code to use agentgateway via GitHub Copilot’s native MCP support. … #### MCP servers - [stdio Transport](https://agentgateway.dev/docs/standalone/latest/integrations/mcp-servers/stdio.md): The stdio transport connects agentgateway to MCP servers that run as local processes, communicating … - [SSE Transport](https://agentgateway.dev/docs/standalone/latest/integrations/mcp-servers/sse.md): Server-Sent Events (SSE) transport allows agentgateway to connect to remote MCP servers over HTTP … - [Streamable HTTP Transport](https://agentgateway.dev/docs/standalone/latest/integrations/mcp-servers/streamable-http.md): Streamable HTTP transport connects agentgateway to remote MCP servers over HTTP with streaming … #### Observability - [OpenTelemetry](https://agentgateway.dev/docs/standalone/latest/integrations/observability/opentelemetry.md): Agentgateway natively supports OpenTelemetry (OTLP) for distributed tracing and metrics export. … - [Prometheus](https://agentgateway.dev/docs/standalone/latest/integrations/observability/prometheus.md): Agentgateway exposes Prometheus-compatible metrics for monitoring and alerting. Metrics endpoint … - [Grafana](https://agentgateway.dev/docs/standalone/latest/integrations/observability/grafana.md): Use Grafana to create dashboards for agentgateway metrics and visualize distributed traces. Quick … - [Jaeger](https://agentgateway.dev/docs/standalone/latest/integrations/observability/jaeger.md): Jaeger is a distributed tracing backend that works with agentgateway’s OpenTelemetry … #### LLM observability - [Langfuse](https://agentgateway.dev/docs/standalone/latest/integrations/llm-observability/langfuse.md): Langfuse is an open-source LLM observability platform that provides prompt management, analytics, … - [LangSmith](https://agentgateway.dev/docs/standalone/latest/integrations/llm-observability/langsmith.md): LangSmith is LangChain’s platform for debugging, testing, evaluating, and monitoring LLM … - [Arize Phoenix](https://agentgateway.dev/docs/standalone/latest/integrations/llm-observability/phoenix.md): Arize Phoenix is an open-source LLM observability platform for tracing, evaluation, and debugging. … #### Networking - [cert-manager](https://agentgateway.dev/docs/standalone/latest/integrations/networking/cert-manager.md): cert-manager automates TLS certificate management in Kubernetes. Use it to automatically provision … - [External DNS](https://agentgateway.dev/docs/standalone/latest/integrations/networking/external-dns.md): External DNS automatically manages DNS records for Kubernetes resources. Use it to automatically … #### Authentication & identity - [Keycloak](https://agentgateway.dev/docs/standalone/latest/integrations/auth/keycloak.md): Keycloak is an open-source identity and access management solution. agentgateway can validate JWTs … - [Auth0](https://agentgateway.dev/docs/standalone/latest/integrations/auth/auth0.md): Auth0 is an identity platform that provides authentication and authorization services. agentgateway … - [Okta](https://agentgateway.dev/docs/standalone/latest/integrations/auth/okta.md): Okta is an enterprise identity platform. agentgateway can validate JWTs issued by Okta for API … #### Platforms - [Kubernetes](https://agentgateway.dev/docs/standalone/latest/integrations/platforms/kubernetes.md): agentgateway runs on any Kubernetes distribution through Agentgateway on Kubernetes, which provides … - [Docker](https://agentgateway.dev/docs/standalone/latest/integrations/platforms/docker.md): Run agentgateway as a Docker container for local development or small deployments. Quick start Get … - [AWS](https://agentgateway.dev/docs/standalone/latest/integrations/platforms/aws.md): Run agentgateway on AWS to leverage Amazon Bedrock, ECS/EKS, and other AWS services. Deployment … - [Google Cloud](https://agentgateway.dev/docs/standalone/latest/integrations/platforms/gcp.md): Run agentgateway on GCP to leverage Vertex AI, GKE, and Google Cloud services. Deployment options … - [Azure](https://agentgateway.dev/docs/standalone/latest/integrations/platforms/azure.md): Run agentgateway on Azure to leverage Azure OpenAI, AKS, and Azure services. Deployment options … ### Operations - [Admin UI](https://agentgateway.dev/docs/standalone/latest/operations/ui.md): Use the agentgateway Admin UI to view and manage your standalone proxy configuration in real time. … - [Debug your setup](https://agentgateway.dev/docs/standalone/latest/operations/debug.md): Use built-in tools to troubleshoot issues in your standalone agentgateway setup. Enable debug logs … ### Reference - [Release notes](https://agentgateway.dev/docs/standalone/latest/reference/release-notes.md): Review the release notes for agentgateway standalone. For more details, review the GitHub release … #### CEL expressions - [CEL playground](https://agentgateway.dev/docs/standalone/latest/reference/cel/playground.md): You can try out CEL expressions directly in the built-in CEL playground in the agentgateway admin … - [CEL in YAML and example expressions](https://agentgateway.dev/docs/standalone/latest/reference/cel/yaml-and-examples.md): CEL in YAML When writing CEL expressions in agentgateway, typically they are expressed as YAML … - [Variables and functions](https://agentgateway.dev/docs/standalone/latest/reference/cel/variables.md): When using CEL expressions, a variety of variables and functions are made available. Variables … - [CEL reference](https://agentgateway.dev/docs/standalone/latest/reference/cel/cel-context.md): apiKey apiKey contains the claims from a verified API Key. This is only present if the API Key … #### Configuration reference - [Schema validation](https://agentgateway.dev/docs/standalone/latest/reference/configuration/validation.md): Many integrated development environments (IDEs) and editors support schema validation for your … - [Configuration schema](https://agentgateway.dev/docs/standalone/latest/reference/configuration/schema.md): Generated from the agentgateway JSON schema. Global Config Top-level settings for DNS, admin, … #### Observability - [Metrics](https://agentgateway.dev/docs/standalone/latest/reference/observability/metrics.md): The agentgateway comes with a built-in metrics endpoint that you can use to monitor traffic that is … - [Traces](https://agentgateway.dev/docs/standalone/latest/reference/observability/traces.md): The agentgateway integrates with Jaeger as the tracing platform. Jaeger is an open source tool that … --- Generated on 2026-05-04 16:33:09 UTC