Observability
Tracing, prompt logging, cost tracking, and metrics for your gateways.
Gain insight into the health and performance of your gateway environment. Get prompt logging, cost tracking, and an audit trail for LLM traffic via OpenTelemetry.
External observability platforms
For specialized LLM observability platforms with prompt logging, cost tracking, and evaluation capabilities, see the LLM Observability integrations.