seldon
v0
Log inSign up
Docs menu

Reference

Models

GET /v1/models — list the models your workspace can route to, with providers, prices, limits and live stats.

Shell
curl "$SELDON_BASE_URL/models" -H "Authorization: Bearer $SELDON_API_KEY"

Returns the OpenAI list shape, so client.models.list() works in the OpenAI SDKs. The first entry is always auto. The public catalog with descriptions is at Models.

Response

JSON
{
  "object": "list",
  "data": [
    { "id": "auto", "object": "model", "created": 0, "owned_by": "seldon" },
    {
      "id": "openai/gpt-5.4-nano",
      "object": "model",
      "created": 0,
      "owned_by": "seldon",
      "display_name": "…",
      "context_length": 400000,
      "input_price_per_million": "0.05",
      "output_price_per_million": "0.40",
      "modalities": ["text", "image"],
      "routable": true,
      "providers": [
        {
          "provider": "azure-openai",
          "provider_display_name": "…",
          "input_price_per_million": "0.05",
          "output_price_per_million": "0.40",
          "context_length": 400000,
          "routable": true,
          "supported_params": { "tools": true, "vision": true, "json_mode": true, "json_schema": true },
          "rate_limit_rpm": 1000,
          "rate_limit_tpm": 1000000,
          "rate_limit_tpd": null,
          "max_output_tokens": 128000
        }
      ],
      "stats": { "median_latency_ms": 900, "throughput_rpm": "120", "uptime": "0.999" }
    }
  ]
}

Values above are illustrative.

Fields

FieldNotes
idUse as model in requests.
owned_byseldon when several providers serve the model; otherwise the provider.
input_price_per_million, output_price_per_millionUSD per million tokens, as decimal strings.
routableWhether a request can be served now. Non-routable models return 400 model_not_routable.
providers[]Each offering: price, context length, supported_params, upstream rate limits and max_output_tokens. The provider slug is what provider.order, only and deny accept.
statsMedian latency, throughput and uptime, used by provider.sort. Values may be null when not yet measured.
cardOptional description, publisher, family and tags.