---
id: provider-throughput-october-2026
slug: provider-throughput-density-october-2026
title: "Provider throughput density, October 2026"
topic: latency
period: Oct 2026
updated: 2026-11-11
license: CC BY 4.0
canonical: https://www.requesty.ai/data/provider-throughput-density-october-2026
---

# Provider throughput density, October 2026

> Which providers emit tokens fastest? In October 2026 Typesafe led at a median 889 output tokens per second of total latency. Parasail was slowest at 28 tokens per second.

*Topic: Latency and performance. Period: Oct 2026. Last updated 2026-11-11.*

## Why it matters

Tokens per second of wall-clock time is a rough measure of how quickly a provider turns a request into output. It depends on the model mix, so a provider serving small models will look faster.

## Questions this answers

- Which AI provider has the highest tokens per second?
- How fast do providers generate output tokens?
- Which providers are slowest per token?

## Key findings

1. Typesafe: 889 tokens/sec.
2. DeepSeek: 149 tokens/sec.
3. Melious: 106 tokens/sec.
4. Anthropic: 88 tokens/sec.

## Data

| Provider | p50 tokens / sec | p50 ms / token (milliseconds) |
| --- | --- | --- |
| Vertex (Gemini) | 49 | 20 ms |
| Azure | 68 | 15 ms |
| Typesafe | 889 | 1 ms |
| TensorX | 37 | 27 ms |
| OpenAI | 45 | 22 ms |
| DeepInfra | 37 | 27 ms |
| Nebius | 82 | 12 ms |
| Bedrock | 51 | 20 ms |
| Sference | 79 | 13 ms |
| Anthropic | 88 | 11 ms |
| DeepSeek | 149 | 7 ms |
| Vertex (Claude) | 84 | 12 ms |
| Novita | 31 | 33 ms |
| Melious | 106 | 10 ms |
| Parasail | 28 | 36 ms |

## Caveats

- Successful requests with output tokens only. Typesafe serves short, fixed-format completions, which inflates its rate.

## Cite as

**APA.** Requesty (2026). Provider throughput density, October 2026. Requesty Data. https://www.requesty.ai/data/provider-throughput-density-october-2026

```bibtex
@misc{requesty_provider_throughput_density_october_2026,
  author       = {{Requesty}},
  title        = {Provider throughput density, October 2026},
  year         = {2026},
  howpublished = {\url{https://www.requesty.ai/data/provider-throughput-density-october-2026}},
  note         = {Requesty Data}
}
```

---

Downloads: [JSON](https://www.requesty.ai/data/provider-throughput-density-october-2026/data.json) · [CSV](https://www.requesty.ai/data/provider-throughput-density-october-2026/data.csv) · [Markdown](https://www.requesty.ai/data/provider-throughput-density-october-2026/data.md)