API Types
9 items
About
Overview of supported LLM providers and their capabilities
Manage API keys
Manage API keys for LLM provider authentication.
Routing-based configuration for LLMs
Use traditional HTTP routing configuration for advanced use cases like path-based routing and
Cost Controls
4 items
Observe traffic
Capture LLM metrics, logs, and traces, including request and response bodies and token usage,
LLM playground
Send a test chat completion through the gateway in the agentgateway admin UI.
Transform requests
Verified Code examples on this page have been automatically tested and verified.
Virtual models
Configure virtual models with weighted, failover, and conditional routing in simplified LLM mode.
Prompt Guards
8 items
Providers
21 items