Model Comparison
Gemini 1.5 Pro (May '24)
vs. GPT-4o mini Realtime (Dec '24)
Comparing 2 AI models · 7 benchmarks · Google, OpenAI
Lowest Price
Gemini 1.5 Pro (May '24)
$0.00/1M input price
Best for Coding
Gemini 1.5 Pro (May '24)
19.8 coding index
Composite Indices
Higher is better; speed and price are normalized
Standard Benchmarks
Only benchmarks with data are shown
Response Face-Off
Run one prompt through the selected models and compare response quality with live speed and cost context.
Gemini 1.5 Pro (May '24)
TTFT
—
Time
—
tok/s
—
Tokens
—
Cost
—
GPT-4o mini Realtime (Dec '24)
OpenAI
TTFT
—
Time
—
tok/s
—
Tokens
—
Cost
—
Which answer was more useful?
Full Comparison
| Metric | Go Gemini 1.5 Pro (May '24) | Op GPT-4o mini Realtime (Dec '24) |
|---|---|---|
| Pricing per 1M tokens | ||
| Input Cost | $0.00/1M | $0.00/1M |
| Output Cost | $0.00/1M | $0.00/1M |
| Specifications | ||
| Organization | OpenAI | |
| Release Date | May 15, 2024 | Dec 17, 2024 |
| Performance & Speed | ||
| Throughput | — | — |
| TTFT | — | — |
| Latency | — | — |
| Composite Indices | ||
| Reasoning Score | 25.7 | — |
| Intelligence | 12.0 | — |
| Coding | 19.8 | — |
| Standard Benchmarks | ||
| GPQA | 37.1% | — |
| MMLU Pro | 65.7% | — |
| HLE | 3.9% | — |
| LiveCodeBench | 24.4% | — |
| MATH 500 | 67.3% | — |
| AIME (Original) | 8.0% | — |
| SciCode | 27.4% | — |
Key Takeaways
Gemini 1.5 Pro (May '24) offers the best value at $0.00/1M, making it ideal for high-volume applications and cost-conscious projects.
Gemini 1.5 Pro (May '24) reaches a 19.8 coding index, making it the top choice for software development and code generation tasks.
All models support context windows of ∞+ tokens, suitable for processing lengthy documents and maintaining extended conversations.
When to Choose Each Model
Gemini 1.5 Pro (May '24)
- Cost-sensitive applications
- High-volume processing
- Code generation
- Software development
GPT-4o mini Realtime (Dec '24)
- General-purpose AI
- Versatile applications
