Melious had the fastest median time to first token among major providers in October 2026 at 603 ms. The median major provider took 1.71 s.

Key findings

1. 01Fastest median TTFT: Melious at 603 ms, then Sference at 685 ms.
2. 02Highest median output speed: Lyceum at 193 tokens per second.
3. 03Fastest median full streamed response: Mistral at 1.89 s.
4. 04Vertex (Gemini) moved the most since September 2026: median TTFT went from 2.06 s to 3.62 s (+1.56 s).

Median time to first token by month

What changed since September 2026

• Vertex (Gemini)2.06 s → 3.62 s (+1.56 s)
• Anthropic1.52 s → 2.98 s (+1.45 s)
• OpenAI1.16 s → 2.54 s (+1.38 s)
• Bedrock1.70 s → 3.04 s (+1.33 s)
• Azure796 ms → 1.75 s (+958 ms)

What to do about it

• Compare providers on the same model in /rankings before switching. Provider medians mix many models.
• If p90 matters more than the median, use latency-based routing across providers for the same model.

Data

17 rows published. Rows below the floors are withheld.

Questions this answers

Which LLM API has the lowest latency?

Melious had the fastest median time to first token among major providers in October 2026 at 603 ms. The median major provider took 1.71 s.

What is the median time to first token for LLM providers?

Melious had the fastest median time to first token among major providers in October 2026 at 603 ms. The median major provider took 1.71 s.

Which provider streams the most tokens per second?

Melious had the fastest median time to first token among major providers in October 2026 at 603 ms. The median major provider took 1.71 s.

How long does a full streamed LLM response take?

Melious had the fastest median time to first token among major providers in October 2026 at 603 ms. The median major provider took 1.71 s.

Method and definitions

• Time to first token and tokens per second are measured on streamed, successful requests only, with the same formulas /rankings uses. Tokens per second counts visible output tokens after the first token, with a 250 ms floor on decode time and at least 20 output tokens.
• A provider needs at least 500 streamed successes in the month for latency to be published. Only providers with at least 0.5% of published traffic are shown.
• A row is published only when it has at least 20 requests, at least 5 distinct organizations, and no single organization above 80% of its traffic. These are the same floors /rankings uses. Rows below the floors are withheld, not estimated.
• Only shares, rates, medians and organization bands are published. Absolute request, token and spend totals stay private.

TTFT:

Time from the gateway sending the request to the first streamed token from the provider.

p90:

90% of requests were faster than this.

Total:

Time from the gateway sending the request to the last streamed token.

Per-model numbers with the same definitions are on /rankings, refreshed weekly.

Caveats

• Latency depends on the model mix. A provider serving mostly small models will look faster than one serving large reasoning models.
• Reasoning models think before the first visible token, which raises TTFT.

Revision history and other months

• October 2026 (this page)first published 2026-11-11
• September 2026first published 2026-11-11
• August 2026first published 2026-11-11
• July 2026first published 2026-11-11
• June 2026first published 2026-11-11
• May 2026first published 2026-11-11

Related

• Provider error ratesHow often do LLM providers return errors, and what kind?
• Prompt cache hit rate by providerWhat share of input tokens do LLM providers serve from prompt cache?
• Latency leaderboard, October 2026 (top 10 providers by volume)April 2026 note
• p50 latency year over year: October 2025 to October 2026April 2026 note
• Provider throughput density, October 2026April 2026 note
• Streaming TTFT vs total latency, April 2026April 2026 note

Cite and reuse

Free to reuse under CC BY 4.0. Credit "Requesty Data" and link to this page. Cite the month URL so the numbers you quote stay fixed.

Requesty (2026). Time to first token by provider, October 2026. Requesty Data. https://www.requesty.ai/data/provider-latency/2026-10

@misc{requesty_provider_latency_2026_10,
  author       = {{Requesty}},
  title        = {Time to first token by provider, October 2026},
  year         = {2026},
  howpublished = {\url{https://www.requesty.ai/data/provider-latency/2026-10}},
  note         = {Requesty Data}
}

period,provider,ttft_p50_ms,ttft_p90_ms,stream_total_p50_ms,tps_p50,stream_share_fraction,sample_band
2026-10,Melious,603,2245,2978,75.5,0.7146,500+
2026-10,Sference,685,3270,2175,186.2,0.3777,500+
2026-10,Mistral,1107,6494,1889,141.7,0.3756,500+
…