Leaderboard
Lowest p95 latency first, then time to the first token.
Models measured
19
Total requests
27.8K
In the last All time
Total tokens
3.1B
Input + output, last All time
DeepSeek V4.1 Flash
deepseek-v4.1-flash
4,320 hours of data, from Apr 19, 2026, 12:38 PM to Oct 16, 2026, 12:38 PM; updated Oct 16, 2026, 12:38 PM.
Share is each model's part of all requests (or tokens) across the models listed here, in the selected range.
Requests is the number of finished requests (successful, failed or with an unknown outcome) a model served in the selected range. Requests refused before they were sent are not counted.
Tokens used is the input plus output tokens a model's requests reported in the selected range.
Latency (p50, p95, p99) is measured on successful requests.
TTFT is the average time to the first token of successful requests.
Throughput is output tokens per second while the model is answering.
Success rate = successful requests / all finished requests. Failed, timed-out and cut-off requests all count as unsuccessful.
Status shows whether a model is currently healthy, degraded or unavailable.
Ranked by lowest p95 latency, then lowest TTFT.
Notes:
These are observed figures, not a service-level commitment.
Gemini 3.8 Flash High
gemini-3.8-flash-high
Gemini 3.1 Pro
gemini-3.1-pro
Claude Haiku 5.5
claude-haiku-5-5
Claude Opus 5.5
claude-opus-5-5
Claude Opus 5
claude-opus-5
Gemini 4 Argon
gemini-4-argon
GPT 6 Astra Cheap
gpt-6-astra-cheap
GPT 6 Sol Cheap
gpt-6-sol-cheap
Claude Sonnet 5.5
claude-sonnet-5-5
Claude Opus 5.5 Cheap
claude-opus-5.5-cheap
Claude Haiku 4.5
claude-haiku-4.5
Qwen3.8-max 40đ
qwen3.8-max-40
GPT 5.6 Terra
gpt-5.6-terra
GPT 5.6 Luna
gpt-5.6-luna
Claude Opus 4.6
claude-opus-4-6
GPT 6.1 Sol
gpt-6.1-sol
GPT 6 Luna
gpt-6-luna
GPT 6 Sol
gpt-6-sol