cd /news/ai-infrastructure/perplexity-s-orchestrator-api-routes… · home › topics › ai-infrastructure › article
[ARTICLE · art-171946] src=alphasignal.ai ↗ pub= topic=ai-infrastructure verified=true sentiment=↑ positive

Perplexity's Orchestrator API Routes 45+ Models Without Provider Outages

Perplexity launched the Orchestrator API, a single endpoint giving developers one key to more than 45 open and proprietary models from OpenAI, Anthropic, Google and xAI, with automatic provider failover. If a deployment fails, Orchestrator retries the same model elsewhere — for example moving a Claude request from Anthropic to AWS Bedrock — and bills at each model's published per-token rates with no platform fee, not charging requests that fail before producing output. The private-preview API works with OpenAI Chat Completions, Responses and Anthropic Messages SDKs via a new base URL, and its optional perplexity/auto router raised Terminal-Bench subset solves from 38 to 41 of 63 by routing around refusals, at higher cost.

key takeaway

Orchestrator lets existing OpenAI Chat Completions, Responses or Anthropic Messages clients switch to a new base URL for 45+ models with automatic failover, and its perplexity/auto router lifted Terminal-Bench subset solves from 38 to 41 of 63 at higher cost.

read7 min views2 publishedNov 17, 2026
Perplexity's Orchestrator API Routes 45+ Models Without Provider Outages
Image: Alphasignal (auto-discovered)

Perplexity has opened up the model routing layer it uses in production. One API key now reaches 45+ open and proprietary models, with automatic provider failover, one bill, and an optional router that picks a model for each request.

  • Perplexity launched the Orchestrator API : 45+ open and proprietary models behind one key.
  • If a provider fails, Orchestrator retries on another deployment of the same model, e.g. Claude moves from Anthropic to Bedrock.
  • Billing uses each model's published per-token rates, with no platform fee; requests that fail before producing output aren't charged.
  • Works with OpenAI Chat Completions, Responses and Anthropic Messages SDKs via a new base URL .
  • Preview perplexity/autorouting sends each request to a model based on plain-English task descriptions.
  • Routing around refusals raised Terminal-Bench subset solves from 38 to 41 of 63, at higher cost.

Perplexity has launched the Orchestrator API, a single endpoint for proprietary and open-weight models. It selects a provider for each request based on availability, capacity, and latency, then retries failures on another deployment of the requested model. The private-preview catalog includes more than 45 models from OpenAI, Anthropic, Google, and xAI, alongside models hosted by Perplexity.

The API exposes two routing layers. Provider routing chooses where to run a requested model, while optional automatic routing chooses a model from task descriptions supplied by the developer. Perplexity says the underlying infrastructure handles hundreds of millions of daily requests across more than 85 models and a dozen providers.

One model, several hosts #

An application tied directly to one model provider inherits that provider’s outages, rate limits, and latency spikes. Orchestrator separates the requested model from its host, allowing a Claude request that fails on Anthropic, for example, to run through AWS Bedrock when the same model is available there. This can reduce user-visible failures and replace provider-specific retry code.

  • Traffic is distributed across deployments according to observed error rates, available capacity, and latency. Degraded deployments receive less traffic until they recover.
  • Provider errors, rate limits, and timeouts trigger a retry on another deployment of the same model.
  • Each attempt has limits for time to first token and total duration. Exceeding either limit counts as a failure.
  • If every deployment fails, the API returns HTTP 429 with a Retry-After header.
  • Requests rejected for rate-limit errors are not charged.

Perplexity reports that Claude and GPT requests sent through Orchestrator succeeded more often over a 30-day period than requests sent to any single provider it tracked. Daily success rates also varied less during provider incidents.

Measurement Perplexity’s reported result
Fastest Claude Opus 5.5 provider Anthropic led on 15 days and AWS Bedrock led on 15 days.
GPT-5.6 Sol output speed Azure’s median was 27% higher than OpenAI’s.

These vendor-supplied measurements show why static provider selection can become stale, although they do not establish how Orchestrator will perform for a particular workload. Production evaluations should track success rate, first-token latency, total latency, and cost using representative prompts.

Swap the base URL #

Existing clients can send OpenAI Chat Completions, OpenAI Responses, or Anthropic Messages requests without adopting a new SDK. OpenAI-compatible clients use https://api.perplexity.ai/orchestrator/v1, and existing Perplexity API keys work without modification.

Anthropic SDKs require https://api.perplexity.ai/orchestrator as the base URL because those clients append /v1/messages. Perplexity documents the difference in its FAQ.

from openai import OpenAI
import os

client = OpenAI(
    api_key=os.environ["PERPLEXITY_API_KEY"],
    base_url="https://api.perplexity.ai/orchestrator/v1",
)

response = client.chat.completions.create(
    model="anthropic/claude-opus-5-5",
    messages=[
        {
            "role": "user",
            "content": "Summarize this incident log.",
        }
    ],
)

print(response.model)
print(response.choices[0].message.content)

Every request must include the full conversation because Orchestrator is stateless. A stable prompt_cache_key or x-session-id gives the conversation best-effort affinity with one deployment, improving the chance of reusing cached prompt prefixes. Failover can still move the request elsewhere.

The model catalog depends on the account’s usage tier. Calling GET /orchestrator/v1/models returns the models available to the current project.

Describe the job, then route it #

Automatic routing, currently in preview, selects a model for each conversation turn. Developers set model to perplexity/auto and provide a routing object containing a default_model plus one to five named routes. Each route combines a plain-language task description with a model ID.

A lightweight decision model compares the conversation with those descriptions. It sees the route descriptions without seeing their assigned model names, then selects a route or returns none, which invokes the default model.

Support route Assigned model Example work
Default GLM-5.3 Flash Routine requests such as changing an account email
billing_dispute Claude Opus 5.5 Refunds, disputed charges, and escalated customers
technical_issue GPT-6.1 Sol Bugs, error messages, and broken integrations

Response headers expose the routing decision. x-perplexity-autoroute-route identifies the matched route, x-perplexity-autoroute-outcome records whether routing succeeded or used the default, and a confidence header reports the decision model’s probability. Setting "reasoning_effort": "auto" also lets the decision model choose low, medium, or high reasoning effort for the request.

Routing runs again on every turn, allowing one conversation to move among models as its task changes. In Perplexity’s coding example, Opus diagnoses a bug, Sol plans a multi-module refactor, and GLM Flash writes the docstring from the accumulated conversation. Each model maintains its own prompt cache, so returning to a previously used model can reuse its cached prefix.

Three more solves, at a higher cost #

Perplexity also tested automatic routing as a response to predictable model refusals. Anthropic has documented cases in which Claude Fable 5.2 safeguards block legitimate cybersecurity and life-sciences work. Perplexity ran Claude Code against a self-selected 63-task subset of Terminal-Bench 4.1, a benchmark of agentic terminal tasks. Fable remained the default, while security, biology, and after_refusal routes used a GPT-6 model.

Configuration Tasks solved Reported cost
Fable only 38 of 63 Lower
Either routed setup 41 of 63 Higher

The three additional solves represent a modest gain on a subset chosen by Perplexity, and the company labels its cost figures as estimates. The result supports a narrower use case: keep a preferred model as the default and route known refusal categories to another model. Broader cost and quality claims require evaluation against an application’s own traffic.

Published rates replace provider contracts #

Orchestrator charges each model’s published per-token rate regardless of which provider serves the request. Perplexity adds no platform fee, and usage draws from the same prepaid credits as other Perplexity API products. Customers can also purchase credits through AWS Marketplace.

Project administrators can review spending by model, project, and API key, then apply model allowlists and spending caps.

Teams cannot supply OpenAI, Anthropic, or other provider keys to Orchestrator. Requests use Perplexity’s provider relationships and billing, so customers with negotiated enterprise rates lose those rates for traffic sent through this API.

Preview edges #

  • Media bypasses automatic routing. Conversations containing images, audio, video, or files go directly to the configured default model.
  • Each configuration supports five routes. Route descriptions are limited to 1,000 bytes, which constrains detailed task taxonomies.
  • Model selection does not use live speed data. Provider routing already considers latency after a model has been chosen. Perplexity says automatic model selection based on speed remains in development.
  • Interrupted streams are not retried. A stream that fails after output begins ends with an in-band error. The delivered tokens remain billable.
  • Access remains gated. The Orchestrator API is in private preview, with access available by emailingapi@perplexity.ai . Automatic routing has a separate preview, and its built-in default policy requires usage Tier 1 or higher.

The teams it suits #

OpenRouter already offers unified access, billing, fallbacks, and routing across hundreds of open and proprietary models. Perplexity has a smaller catalog and draws on infrastructure built for its own production traffic. Its distinguishing features are same-model failover across hosts, Perplexity-hosted open-weight models, and task routing configured through plain-language descriptions.

Teams already maintaining multiple model integrations could use Orchestrator to consolidate authentication, retries, provider selection, and billing behind one endpoint. Workloads with predictable refusal categories or a mix of simple and complex requests could also benefit from the automatic-routing preview.

Provider contracts, multimodal routing, and recovery from interrupted streams remain clear constraints. A production trial should measure route accuracy, model quality, latency, cache reuse, failure rates, and total cost against the existing stack before moving critical traffic.

── more in #ai-infrastructure 4 stories · sorted by recency
── more on @perplexity 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/perplexity-s-orchest…] indexed:0 read:7min 2026-11-17 · —