Model Comparison
Devstral Small (May '25)
vs. Gemini 3.1 Pro Preview
Comparing 2 AI models · 11 benchmarks · Mistral, Google
Recommended Pick
Go Gemini 3.1 Pro Preview 11 metric wins Strongest on: Throughput, Reasoning, Intelligence
Lowest Price
Devstral Small (May '25)
$0.00/1M input price
Best Reasoning
Gemini 3.1 Pro Preview
65.3 reasoning score
Blends available reasoning benchmarks
Best for Coding
Gemini 3.1 Pro Preview
55.5 coding index
Composite Indices
Higher is better; speed and price are normalized
Standard Benchmarks
Only benchmarks with data are shown
Differences That Matter
Price gap
Devstral Small (May '25) is ∞x cheaper on input tokens than Gemini 3.1 Pro Preview.
Reasoning gap
Gemini 3.1 Pro Preview leads Devstral Small (May '25) by 37.2 points on reasoning.
Coding gap
Gemini 3.1 Pro Preview leads Devstral Small (May '25) by 43.3 points on coding.
Top-pick rationale
Gemini 3.1 Pro Preview wins 11 measurable categories, including Throughput, Reasoning, Intelligence, Coding.
Response Face-Off
Run one prompt through the selected models and compare response quality with live speed and cost context.
Devstral Small (May '25)
Mistral
TTFT
—
Time
—
tok/s
—
Tokens
—
Cost
—
Gemini 3.1 Pro Preview
TTFT
—
Time
—
tok/s
—
Tokens
—
Cost
—
Which answer was more useful?
Full Comparison
| Metric | Mi Devstral Small (May '25) | Top Pick Go Gemini 3.1 Pro Preview |
|---|---|---|
| Pricing per 1M tokens | ||
| Input Cost | $0.00/1M | $2.00/1M |
| Output Cost | $0.00/1M | $12.00/1M |
| Blended (3:1) | — | $4.50/1M |
| Specifications | ||
| Organization | Mistral | |
| Release Date | May 21, 2025 | Feb 19, 2026 |
| Performance & Speed | ||
| Throughput | — | 141.6 tok/s |
| TTFT | — | 37060ms |
| Latency | — | 37060ms |
| Composite Indices | ||
| Value Score | — | 100.0 |
| Reasoning Score | 28.1 | 65.3 |
| Intelligence | 18.0 | 57.2 |
| Coding | 12.2 | 55.5 |
| Standard Benchmarks | ||
| GPQA | 43.4% | 94.1% |
| MMLU Pro | 63.2% | — |
| HLE | 4.0% | 44.7% |
| LiveCodeBench | 25.8% | — |
| MATH 500 | 68.4% | — |
| AIME (Original) | 6.7% | — |
| SciCode | 24.5% | 58.9% |
| LCR | 26.7% | 72.7% |
| IFBench | 31.6% | 77.1% |
| TAU-bench v2 | 38.0% | 95.6% |
| TerminalBench Hard | 6.1% | 53.8% |
Key Takeaways
Devstral Small (May '25) offers the best value at $0.00/1M, making it ideal for high-volume applications and cost-conscious projects.
Gemini 3.1 Pro Preview has the strongest reasoning profile with a 65.3 reasoning score, combining the available reasoning-heavy benchmarks.
Gemini 3.1 Pro Preview reaches a 55.5 coding index, making it the top choice for software development and code generation tasks.
All models support context windows of ∞+ tokens, suitable for processing lengthy documents and maintaining extended conversations.
When to Choose Each Model
Devstral Small (May '25)
- Cost-sensitive applications
- High-volume processing
Gemini 3.1 Pro Preview
- Complex reasoning tasks
- Research & analysis
- Code generation
- Software development
