Multiple LLM providers

Verified Code examples on this page have been automatically tested and verified.

Define reusable LLM provider configurations once and reference them across multiple model definitions to avoid duplicating connection and authentication parameters.

Reusable provider configuration

Reuse provider configuration to avoid duplicating connection and authentication parameters across multiple model definitions. Define named provider defaults once in llm.providers[] and reference them from multiple llm.models[] entries with provider.reference.

llm:
  providers:
  - name: openai-prod
    provider: openAI
    params:
      apiKey: "$OPENAI_API_KEY"

  models:
  - name: fast
    provider:
      reference: openai-prod
    params:
      model: gpt-4o-mini
  - name: smart
    provider:
      reference: openai-prod
    params:
      model: gpt-4o

In this example, smart inherits the upstream API key from llm.providers[] and only changes the model name.

Named providers can hold shared upstream settings you want to reuse, such as authentication, host overrides, path overrides, or other model defaults. Keep the shared values on llm.providers[] and only set per-model differences on llm.models[].