Model Comparison

Reka Flash (Sep '24)
vs. Llama 3.1 Tulu3 405B

Comparing 2 AI models · 7 benchmarks · Reka AI, Allen Institute for AI

Recommended Pick

Allen Institute for AI logo Llama 3.1 Tulu3 405B 6 metric wins

Strongest on: Input price, Output price, TTFT

Lowest Price

Allen Institute for AI logo

Llama 3.1 Tulu3 405B

$0.00/1M input price

Best Reasoning

Reka AI logo

Reka Flash (Sep '24)

32.4 reasoning score

Blends available reasoning benchmarks

Composite Indices

Higher is better; speed and price are normalized

Standard Benchmarks

Only benchmarks with data are shown

Differences That Matter

Price gap

Llama 3.1 Tulu3 405B is ∞x cheaper on input tokens than Reka Flash (Sep '24).

Reasoning gap

Reka Flash (Sep '24) leads Llama 3.1 Tulu3 405B by 0.4 points on reasoning.

Top-pick rationale

Llama 3.1 Tulu3 405B wins 6 measurable categories, including Input price, Output price, TTFT, Latency.

Live compare

Response Face-Off

Run one prompt through the selected models and compare response quality with live speed and cost context.

Reka AI logo

Reka Flash (Sep '24)

Reka AI

Waiting

TTFT

Time

tok/s

Tokens

Cost

Waiting
Allen Institute for AI logo

Llama 3.1 Tulu3 405B

Allen Institute for AI

Waiting

TTFT

Time

tok/s

Tokens

Cost

Waiting

Which answer was more useful?

AI Chat

Chat with 80+ models

Inference API

EU-hosted inference

Full Comparison

Metric
Reka AI logo Reka Flash (Sep '24)
Reka AI
Top Pick
Allen Institute for AI logo Llama 3.1 Tulu3 405B
Allen Institute for AI
Pricing per 1M tokens
Input Cost $0.20/1M$0.00/1M
Output Cost $0.80/1M$0.00/1M
Blended (3:1) $0.35/1M
Specifications
Organization Reka AIAllen Institute for AI
Release Date Oct 4, 2024Jan 30, 2025
Performance & Speed
Throughput 85.9 tok/s
TTFT 1779ms
Latency 1779ms
Composite Indices
Value Score 100.0
Reasoning Score 32.432.1
Intelligence 12.014.1
Standard Benchmarks
GPQA 51.6%
MMLU Pro 71.6%
HLE 3.5%
LiveCodeBench 29.1%
MATH 500 52.9%77.8%
AIME (Original) 13.3%
SciCode 30.2%

Key Takeaways

Llama 3.1 Tulu3 405B offers the best value at $0.00/1M, making it ideal for high-volume applications and cost-conscious projects.

Reka Flash (Sep '24) has the strongest reasoning profile with a 32.4 reasoning score, combining the available reasoning-heavy benchmarks.

All models support context windows of ∞+ tokens, suitable for processing lengthy documents and maintaining extended conversations.

When to Choose Each Model

Reka AI logo

Reka Flash (Sep '24)

  • Complex reasoning tasks
  • Research & analysis
Allen Institute for AI logo

Llama 3.1 Tulu3 405B

  • Cost-sensitive applications
  • High-volume processing