Model Comparison
Claude 3.5 Sonnet (June '24)
vs. GLM-5.1 (Reasoning)
Comparing 2 AI models · 10 benchmarks · Anthropic, Z AI
Recommended Pick
Z GLM-5.1 (Reasoning) 11 metric wins Strongest on: Value, Input price, Output price
Best Value
GLM-5.1 (Reasoning)
100.0 value score
55.4 reasoning / $2.15/1M
Lowest Price
GLM-5.1 (Reasoning)
$1.40/1M input price
Best Reasoning
GLM-5.1 (Reasoning)
55.4 reasoning score
Blends available reasoning benchmarks
Best for Coding
GLM-5.1 (Reasoning)
43.4 coding index
Composite Indices
Higher is better; speed and price are normalized
Standard Benchmarks
Only benchmarks with data are shown
Differences That Matter
Best value
GLM-5.1 (Reasoning) has the strongest quality-to-price mix at 100.0 out of 100 value points.
Price gap
GLM-5.1 (Reasoning) is 2.7x cheaper on input tokens than Claude 3.5 Sonnet (June '24).
Reasoning gap
GLM-5.1 (Reasoning) leads Claude 3.5 Sonnet (June '24) by 24.8 points on reasoning.
Coding gap
GLM-5.1 (Reasoning) leads Claude 3.5 Sonnet (June '24) by 17.4 points on coding.
Top-pick rationale
GLM-5.1 (Reasoning) wins 11 measurable categories, including Value, Input price, Output price, Blended price.
Response Face-Off
Run one prompt through the selected models and compare response quality with live speed and cost context.
Claude 3.5 Sonnet (June '24)
Anthropic
TTFT
—
Time
—
tok/s
—
Tokens
—
Cost
—
GLM-5.1 (Reasoning)
Z AI
TTFT
—
Time
—
tok/s
—
Tokens
—
Cost
—
Which answer was more useful?
Full Comparison
| Metric | An Claude 3.5 Sonnet (June '24) | Top Pick Z GLM-5.1 (Reasoning) |
|---|---|---|
| Pricing per 1M tokens | ||
| Input Cost | $3.75/1M | $1.40/1M |
| Output Cost | $15.00/1M | $4.40/1M |
| Blended (3:1) | $6.56/1M | $2.15/1M |
| Specifications | ||
| Organization | Anthropic | Z AI |
| Release Date | Jun 21, 2024 | Apr 7, 2026 |
| Performance & Speed | ||
| Throughput | — | 74.0 tok/s |
| TTFT | — | 861ms |
| Latency | — | 52064ms |
| Composite Indices | ||
| Value Score | 18.1 | 100.0 |
| Reasoning Score | 30.6 | 55.4 |
| Intelligence | 14.2 | 51.4 |
| Coding | 26.0 | 43.4 |
| Standard Benchmarks | ||
| GPQA | 56.0% | 86.8% |
| MMLU Pro | 75.1% | — |
| HLE | 3.7% | 28.0% |
| MATH 500 | 69.5% | — |
| AIME (Original) | 9.7% | — |
| SciCode | 31.6% | 43.8% |
| LCR | — | 62.3% |
| IFBench | — | 76.3% |
| TAU-bench v2 | — | 97.7% |
| TerminalBench Hard | — | 43.2% |
Key Takeaways
GLM-5.1 (Reasoning) offers the best value at $1.40/1M, making it ideal for high-volume applications and cost-conscious projects.
GLM-5.1 (Reasoning) has the strongest reasoning profile with a 55.4 reasoning score, combining the available reasoning-heavy benchmarks.
GLM-5.1 (Reasoning) reaches a 43.4 coding index, making it the top choice for software development and code generation tasks.
All models support context windows of ∞+ tokens, suitable for processing lengthy documents and maintaining extended conversations.
When to Choose Each Model
Claude 3.5 Sonnet (June '24)
- General-purpose AI
- Versatile applications
GLM-5.1 (Reasoning)
- Cost-sensitive applications
- High-volume processing
- Complex reasoning tasks
- Research & analysis
- Code generation
- Software development
