Benchmark avg
30.9
8 tracked scores
ActiveModel portfolio
claude-3-sonnet-20240229
Tap a star to rate
Anthropic · Closed · Context 200K tokens
Cadle Score
123.6
#243 in index
Benchmark average
35.0
Not enough benchmark results yet
Pricing
Unlisted
no list price
MODEL MATRIX · TRUTH CENTER CELLS
Overall
—
Intelligence
—
Coding
53.8
Reasoning
22.2
Language
50.2
Knowledge
67.9
Agentic
—
MMLU
67.9
GPQA
21.7
Math
10.3
LiveCodeBench
—
HumanEval
—
Reason
—
ARC-AGI
—
Coverage AVG
35.0
Pillar Coverage:5 / 7 Core Pillars (71%)
Cadle Cap ranks models with within-benchmark percentiles so ARC-AGI ~40 and MMLU ~90 never compete raw. Coverage AVG is an importance-weighted mean of filled expert cells only — blanks are skipped, not zeroed.
ANALYSIS · TRUTH CENTER
Hard benches (GPQA · ARC-AGI · LCB · Agentic) sit left — a mid-40 on ARC-AGI can still be frontier. Broader benches on the right are easier and often higher.
CADLE INSIGHTS
Only measured signals
Strongest signal
mmlu
Score 67.9
Blended $/1M
Unlisted
No published list price
Context
200K
Provider context window (not max output)
Coding (matrix)
53.8
Model Matrix coding cell
SPEED · COST · QUALITY
Measured matrix and verified gateway observations only.
- Cadle Score
- 123.6
- Matrix Coding
- 53.8
DESCRIPTION + DETAILS
PROVIDER
Anthropic
CONTEXT
200K tokens
STATUS
ACTIVE
COMMUNITY REVIEWS
Community Reviews & Field Notes
Verified EngineersReal operator evaluations, prompt robustness observations, and deployment notes for claude-3-sonnet-20240229.
4.5(2)
Leave a Field Observation
Rating:5 - Frontier benchmark
Role:
Tag topic:
Reviews are publicly visible to the engineering community.
Inference OperatorProduction Deployer Verified
Nov 1, 2026
Tested claude-3-sonnet-20240229 on high-concurrency tool loops. Token generation remains consistent under sustained context load, with minimal prompt drift on complex JSON schemas.
Autonomous Agent LeadEval Maintainer Verified
Oct 28, 2026
Evaluated claude-3-sonnet-20240229 on multi-turn code synthesis. Code reasoning and diff application succeed on ~88% of test suites. Best paired with strict system prompt guardrails.
MODEL COMPARISON
| Metric | |
|---|---|
| Provider | Anthropic |
| Release | |
| Input / 1M | No data yet |
| Output / 1M | No data yet |
| Context | 200K tokens |
| Cadle Cap | 124 |
| Cap board | Cadle Language Cap 124 |
| bigcodebench | 53.8 |
| winogrande | 50.2 |
| mmlu | 67.9 |
| weirdml | 10.2 |
| dtbench | 22.7 |
| otis-mock-aime-2024-2025 | 2.4 |
| math-level-5 | 18.2 |
| gpqa-diamond | 21.7 |
DATA PROVENANCE
Scores may use different scales — check the Benchmarks tab for source links.
- Supabase models
- Cadle public observations
MEASURED CELLS
Same Truth Center numbers as the datasheet above. Accuracy, reliability, safety, and cost scores are not invented.
Coding53.8
MMLU67.9
GPQA21.7
Math10.3