Solar Pro 2 (Reasoning) vs Grok 4

Comparing 2 AI models · 6 benchmarks · Upstage, xAI

Most Affordable
Upstage logo
Solar Pro 2 (Reasoning)
$0.50/1M
Highest Intelligence
xAI logo
Grok 4
87.7% GPQA
Best for Coding
xAI logo
Grok 4
55.1 Coding Index
Price Difference
6.0x
input cost range

Composite Indices

Intelligence, Coding, Math

Standard Benchmarks

Academic and industry benchmarks

Benchmark Winners

6 tests
Upstage logo

Solar Pro 2 (Reasoning)

0

No clear wins

xAI logo

Grok 4

6
  • GPQA
  • MMLU Pro
  • HLE
  • LiveCodeBench
  • MATH 500
  • AIME 2025
Metric
Upstage logo Solar Pro 2 (Reasoning)
Upstage
xAI logo Grok 4
xAI
Pricing
Per 1M tokens
Input Cost $0.50/1M $3.00/1M
Output Cost $0.50/1M $15.00/1M
Blended Cost 3:1 input/output ratio
$0.50/1M $6.00/1M
Specifications
Organization Model creator
Upstage xAI
Release Date Launch date
Jul 9, 2025 Jul 10, 2025
Performance & Speed
Throughput Output speed
107.6 tok/s 37.2 tok/s
Time to First Token (TTFT) Initial response delay
1193ms 9172ms
Latency Time to first answer token
19777ms 9172ms
Composite Indices
Intelligence Index Overall reasoning capability
37.7 65.3
Coding Index Programming ability
31.5 55.1
Math Index Mathematical reasoning
61.3 92.7
Standard Benchmarks
GPQA Graduate-level reasoning
68.7% 87.7%
MMLU Pro Advanced knowledge
80.5% 86.6%
HLE Hard language evaluation
7.0% 23.9%
LiveCodeBench Real-world coding tasks
61.6% 81.9%
MATH 500 Mathematical problems
96.7% 99.0%
AIME 2025 Advanced math competition
61.3% 92.7%
AIME (Original) Math olympiad problems
69.0% 94.3%
SciCode Scientific code generation
30.2% 45.7%
LCR Code review capability
0.0% 68.0%
IFBench Instruction-following
37.1% 53.7%
TAU-bench v2 Tool use & agentic tasks
28.1% 74.9%
TerminalBench Hard CLI command generation
2.8% 37.6%

Key Takeaways

Solar Pro 2 (Reasoning) offers the best value at $0.50/1M, making it ideal for high-volume applications and cost-conscious projects.

Grok 4 leads in reasoning capabilities with a 87.7% GPQA score, excelling at complex analytical tasks and problem-solving.

Grok 4 achieves a 55.1 coding index, making it the top choice for software development and code generation tasks.

All models support context windows of ∞+ tokens, suitable for processing lengthy documents and maintaining extended conversations.

When to Choose Each Model