grok-4 vs gemini-2.5-flash
Side-by-side comparison of grok-4 and gemini-2.5-flash— benchmarks, pricing, context window and capabilities. Both are accessible through Requesty's unified API. grok-4 outperforms gemini-2.5-flash on 11 of 11 shared benchmarks.
xAI Corp.
grok-4
Input / 1M
$3.00
Output / 1M
$15.00
Context
256K
Model ID
xai/grok-4
gemini-2.5-flash
Input / 1M
$0.30
Output / 1M
$2.50
Context
1.0M
Model ID
google/gemini-2.5-flash
Benchmark comparison
Intelligence Indexreasoning
grok-441.5%
gemini-2.5-flash27.0%
Coding Indexcoding
grok-440.5%
gemini-2.5-flash22.2%
Math Indexmath
grok-492.7%
gemini-2.5-flash73.3%
GPQA Diamondreasoning
grok-487.7%
gemini-2.5-flash79.0%
AIME 2025math
grok-492.7%
gemini-2.5-flash73.3%
LiveCodeBenchcoding
grok-481.9%
gemini-2.5-flash69.5%
Terminal-Bench Hardagentic
grok-437.9%
gemini-2.5-flash13.6%
τ²-Benchagentic
grok-474.9%
gemini-2.5-flash31.6%
SciCodecoding
grok-445.7%
gemini-2.5-flash39.4%
MMLU Proknowledge
grok-486.6%
gemini-2.5-flash83.2%
Humanity's Last Examreasoning
grok-423.9%
gemini-2.5-flash11.1%
Scores sourced from official model cards, Artificial Analysis, and public leaderboards. Benchmarks measure specific skills and don't capture every aspect of model quality.
Pricing & specifications
| grok-4 | gemini-2.5-flash | |
|---|---|---|
| Input price / 1M | $3.00 | $0.30 |
| Output price / 1M | $15.00 | $2.50 |
| Context window | 256K tokens | 1.0M tokens |
| Max output | — | 66K tokens |
| Vision input | Yes | Yes |
| Tool calling | Yes | Yes |
| Reasoning | — | Yes |
| Prompt caching | Yes | Yes |
| Computer use | Yes | — |
| Provider | xAI Corp. | Google LLC (Gemini API) |
Questions people ask
Is grok-4 better than gemini-2.5-flash?
grok-4 outperforms gemini-2.5-flash on 11 of 11 shared benchmarks. See the benchmark comparison above for specifics — grok-4 and gemini-2.5-flash have different strengths across reasoning, coding, math and multimodal tasks.
Which is cheaper — grok-4 or gemini-2.5-flash?
gemini-2.5-flash is cheaper. grok-4 costs $3.00/$15.00 per 1M input/output tokens, while gemini-2.5-flash costs $0.30/$2.50.
Can I use grok-4 and gemini-2.5-flash through the same API?
Yes. Requesty provides a single OpenAI-compatible API that routes to both. Change just the "model" parameter to switch — "xai/grok-4" or "google/gemini-2.5-flash" — no other code changes needed.
What are the context windows?
grok-4 supports up to 256K tokens of context. gemini-2.5-flash supports up to 1.0M tokens. Longer context means you can feed larger documents or codebases in a single prompt, though quality often degrades past 128K for most models.
Switch between grok-4 and gemini-2.5-flash with one line of code
Requesty provides a single OpenAI-compatible API for 400+ models. Change the model parameter, not your code.
Get started free