For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.

Observability

Tracing, prompt logging, cost tracking, and metrics for your gateways.

Gain insight into the health and performance of your gateway environment. Get prompt logging, cost tracking, and an audit trail for LLM traffic via OpenTelemetry.

External observability platforms

For specialized LLM observability platforms with prompt logging, cost tracking, and evaluation capabilities, see the LLM Observability integrations.