Model Comparison
Gemma 3 12B Instruct
vs. Gemma 3n E4B Instruct Preview (May '25)
Comparing 2 AI models · 12 benchmarks · Google
Recommended Pick
Strongest on: Reasoning, GPQA, MMLU Pro
Lowest Price
Gemma 3n E4B Instruct Preview (May '25)
$0.00/1M input price
Best Reasoning
Gemma 3 12B Instruct
27.5 reasoning score
Blends available reasoning benchmarks
Best for Coding
Gemma 3 12B Instruct
6.3 coding index
Composite Indices
Higher is better; speed and price are normalized
Standard Benchmarks
Only benchmarks with data are shown
Differences That Matter
Price gap
Gemma 3n E4B Instruct Preview (May '25) is ∞x cheaper on input tokens than Gemma 3 12B Instruct.
Reasoning gap
Gemma 3 12B Instruct leads Gemma 3n E4B Instruct Preview (May '25) by 1.8 points on reasoning.
Top-pick rationale
Gemma 3 12B Instruct wins 6 measurable categories, including Reasoning, GPQA, MMLU Pro, MATH 500.
Response Face-Off
Run one prompt through the selected models and compare response quality with live speed and cost context.
Gemma 3 12B Instruct
TTFT
—
Time
—
tok/s
—
Tokens
—
Cost
—
Gemma 3n E4B Instruct Preview (May '25)
TTFT
—
Time
—
tok/s
—
Tokens
—
Cost
—
Which answer was more useful?
Full Comparison
| Metric | Top Pick Go Gemma 3 12B Instruct | Go Gemma 3n E4B Instruct Preview (May '25) |
|---|---|---|
| Pricing per 1M tokens | ||
| Input Cost | $0.09/1M | $0.00/1M |
| Output Cost | $0.29/1M | $0.00/1M |
| Blended (3:1) | $0.14/1M | — |
| Specifications | ||
| Organization | ||
| Release Date | Mar 12, 2025 | May 20, 2025 |
| Performance & Speed | ||
| Throughput | — | — |
| TTFT | — | — |
| Latency | — | — |
| Composite Indices | ||
| Value Score | 100.0 | — |
| Reasoning Score | 27.5 | 25.7 |
| Intelligence | 8.8 | 10.1 |
| Coding | 6.3 | — |
| Math | 18.3 | — |
| Standard Benchmarks | ||
| GPQA | 34.9% | 27.8% |
| MMLU Pro | 59.5% | 48.3% |
| HLE | 4.8% | 4.9% |
| LiveCodeBench | 13.7% | 13.8% |
| MATH 500 | 85.3% | 74.9% |
| AIME 2025 | 18.3% | — |
| AIME (Original) | 22.0% | 10.7% |
| SciCode | 17.4% | 8.6% |
| LCR | 6.7% | — |
| IFBench | 36.7% | — |
| TAU-bench v2 | 10.8% | — |
| TerminalBench Hard | 0.8% | — |
Key Takeaways
Gemma 3n E4B Instruct Preview (May '25) offers the best value at $0.00/1M, making it ideal for high-volume applications and cost-conscious projects.
Gemma 3 12B Instruct has the strongest reasoning profile with a 27.5 reasoning score, combining the available reasoning-heavy benchmarks.
Gemma 3 12B Instruct reaches a 6.3 coding index, making it the top choice for software development and code generation tasks.
All models support context windows of ∞+ tokens, suitable for processing lengthy documents and maintaining extended conversations.
When to Choose Each Model
Gemma 3 12B Instruct
- Complex reasoning tasks
- Research & analysis
- Code generation
- Software development
Gemma 3n E4B Instruct Preview (May '25)
- Cost-sensitive applications
- High-volume processing