Alibaba · Released 2024-11-11 · v2024-11-11 · Open · Context 131K tokens
ACTIVECodeText
Language Cap
No data yet
language · unranked
Benchmark average
46.9
Not enough benchmark results yet
Pricing
$0.66
$1.00 / 1M out · 4.0 pts/$
CADLE CAP vs MODEL MATRIX
Cadle Cap ranks models on every published score we have for them — harder benchmarks weigh more. Missing tests are skipped, not zeroed. It answers who is stronger than whom in today's pool.
Model Matrix is the datasheet: Overall, Intelligence, Coding, Agentic, MMLU, GPQA, Math, LiveCodeBench, HumanEval, Reason, ARC-AGI. A dash means unmeasured. AVG is an importance-weighted mean of that model's filled cells only.
MODEL MATRIX · TRUTH CENTER CELLS
Overall
26.5
Intelligence
6.7
Coding
No data yet
Agentic
No data yet
MMLU
44.1
GPQA
41.7
Math
76.7
LiveCodeBench
29.5
HumanEval
No data yet
Reason
No data yet
ARC-AGI
No data yet
Coverage AVG
46.9
Cadle Cap ranks models with within-benchmark percentiles so ARC-AGI ~40 and MMLU ~90 never compete raw. Coverage AVG is an importance-weighted mean of filled expert cells only — blanks are skipped, not zeroed.
ANALYSIS · TRUTH CENTER
Hard benches (GPQA · ARC-AGI · LCB · Agentic) sit left — a mid-40 on ARC-AGI can still be frontier. Broader benches on the right are easier and often higher.
We only rank a model once it has enough published benchmark results to compare fairly. Everything below is what we do know: pricing, news and any scores that have been published.
SPEED · COST · QUALITY
Measured matrix / AA / gateway rows only.
Overall (Matrix)
26.5
AA / Intel index
6.7
Input $/1M
$0.66
Output $/1M
$1.00
Value pts/$
4.04
DESCRIPTION + DETAILS
PROVIDER
Alibaba
RELEASE
2024-11-11
CONTEXT
131K tokens
STATUS
ACTIVE
COMMUNITY REVIEWS
OPERATOR NOTES
Quality, latency, cost, and failure modes — not marketing copy.
No reviews yet
WRITE A REVIEW
Tap a star to rate
Stored on this device · synced when signed in
No operator notes yet
First review sets the tone for how teams evaluate Qwen2.5 Coder 32B Instruct.
MODEL COMPARISON
Metric
Qwen2.5 Coder 32B Instruct
Provider
Alibaba
Release
2024-11-11
Input / 1M
$0.66
Output / 1M
$1.00
Context
131K tokens
Cadle Cap
60
Cap board
Unranked
DATA PROVENANCE
Scores may use different scales — check the Benchmarks tab for source links.
Supabase models
Cadle public observations
SOURCE TRACKING
Evidence linked to this model — listing, hub, benchmarks, or live gateway prices.