---
id: latency-leaderboard-october-2026
slug: provider-latency-leaderboard-october-2026
title: "Latency leaderboard, October 2026 (top 10 providers by volume)"
topic: latency
period: Oct 2026
updated: 2026-11-11
license: CC BY 4.0
canonical: https://www.requesty.ai/data/provider-latency-leaderboard-october-2026
---

# Latency leaderboard, October 2026 (top 10 providers by volume)

> Which AI providers are fastest? Among the ten busiest providers in October 2026, Typesafe had the lowest median total latency at 225ms and DeepInfra the highest at 8.0s. DeepInfra had the longest tail with a p95 of 135.6s.

*Topic: Latency and performance. Period: Oct 2026. Last updated 2026-11-11.*

## Why it matters

Median latency shows typical responsiveness, while p95 shows how bad the slow requests get. Both depend heavily on the models each provider serves, so compare providers that serve similar models.

## Questions this answers

- Which AI provider has the lowest latency?
- Which provider has the worst tail latency?
- What is the typical time to first token by provider?

## Key findings

1. Typesafe: p50 225ms, p95 328ms.
2. Nebius: p50 287ms, p95 1.5s.
3. TensorX: p50 360ms, p95 17.7s.
4. Vertex (Gemini): p50 819ms, p95 18.4s.

## Data

| Provider | p50 latency (milliseconds) | p95 latency (milliseconds) | p50 TTFT (milliseconds) |
| --- | --- | --- | --- |
| Vertex (Gemini) | 819 ms | 18.4 s | 3.54 s |
| Azure | 2.74 s | 16.5 s | 1.73 s |
| Typesafe | 225 ms | 328 ms | 224 ms |
| TensorX | 360 ms | 17.7 s | 1.32 s |
| OpenAI | 2.20 s | 15.5 s | 2.43 s |
| DeepInfra | 7.97 s | 135.6 s | 1.51 s |
| Nebius | 287 ms | 1.54 s | 693 ms |
| Bedrock | 4.39 s | 58.7 s | 2.99 s |
| Sference | 2.67 s | 48.3 s | 657 ms |
| Anthropic | 4.00 s | 31.0 s | 2.95 s |

## Caveats

- Latency is total wall-clock time of successful requests and depends on the model mix and output length.
- TTFT uses streamed, successful requests only.

## Cite as

**APA.** Requesty (2026). Latency leaderboard, October 2026 (top 10 providers by volume). Requesty Data. https://www.requesty.ai/data/provider-latency-leaderboard-october-2026

```bibtex
@misc{requesty_provider_latency_leaderboard_october_2026,
  author       = {{Requesty}},
  title        = {Latency leaderboard, October 2026 (top 10 providers by volume)},
  year         = {2026},
  howpublished = {\url{https://www.requesty.ai/data/provider-latency-leaderboard-october-2026}},
  note         = {Requesty Data}
}
```

---

Downloads: [JSON](https://www.requesty.ai/data/provider-latency-leaderboard-october-2026/data.json) · [CSV](https://www.requesty.ai/data/provider-latency-leaderboard-october-2026/data.csv) · [Markdown](https://www.requesty.ai/data/provider-latency-leaderboard-october-2026/data.md)