Skip to main content

Arize Phoenix

Integrate agentgateway with Arize Phoenix for LLM tracing and evaluation

Arize Phoenix is an open-source LLM observability platform for tracing, evaluation, and debugging.

Features​

  • LLM tracing - Trace all LLM calls with full context
  • Evaluation - Built-in LLM evaluators for quality assessment
  • Embedding analysis - Visualize and debug embeddings
  • Dataset management - Create and manage evaluation datasets
  • Open source - Self-host or use Arize cloud

Quick start​

Run Phoenix locally:

pip install arize-phoenix
phoenix serve

Or with Docker:

docker run -p 6006:6006 arizephoenix/phoenix:latest

Access Phoenix at http://localhost:6006.

Configuration​

Phoenix accepts OpenTelemetry traces natively on port 4317 (gRPC) and port 6006 (HTTP), so agentgateway can export traces directly to Phoenix without an intermediate OpenTelemetry Collector.

Configure agentgateway to send traces directly to Phoenix:

# yaml-language-server: $schema=https://agentgateway.dev/schema/config
config:
  tracing:
    otlpEndpoint: http://localhost:4317
    randomSampling: true

gateways:
  default:
    port: 3000
routes:
- backends:
  - ai:
      name: openai
      provider:
        openAI:
          model: gpt-4o-mini
  policies:
    backendAuth:
      key: "$OPENAI_API_KEY"

Docker Compose example​

Agentgateway exports traces directly to Phoenix without needing an OTel Collector:

version: '3'
services:
  agentgateway:
    image: cr.agentgateway.dev/agentgateway:latest
    ports:
      - "3000:3000"
    volumes:
      - ./config.yaml:/config.yaml:ro
    command: ["-f", "/config.yaml"]

  phoenix:
    image: arizephoenix/phoenix:latest
    ports:
      - "6006:6006"
      - "4317:4317"

When using Docker Compose, update your config.yaml to use the Phoenix service name:

config:
  tracing:
    otlpEndpoint: http://phoenix:4317
    randomSampling: true

Learn more​