SPEED · COST · QUALITY
Measured matrix / AA / gateway rows only.
- AA / Intel index
- 5.8
Alibaba · Open weightsQwen2.5 Coder 7B Instruct
Active
Model portfolio
Qwen2.5 Coder 7B Instruct
Tap a star to rate
Alibaba · Released 2024-09-19 · v2024-09-19 · Open
Language Cap
No data yet
language · unranked
Benchmark average
37.6
Not enough benchmark results yet
Pricing
Unlisted
no list price
CADLE CAP vs MODEL MATRIX
Cadle Cap ranks models on every published score we have for them — harder benchmarks weigh more. Missing tests are skipped, not zeroed. It answers who is stronger than whom in today's pool.
Model Matrix is the datasheet: Overall, Intelligence, Coding, Agentic, MMLU, GPQA, Math, LiveCodeBench, HumanEval, Reason, ARC-AGI. A dash means unmeasured. AVG is an importance-weighted mean of that model's filled cells only.
MODEL MATRIX · TRUTH CENTER CELLS
Overall
No data yet
Intelligence
5.8
Coding
No data yet
Agentic
No data yet
MMLU
47.3
GPQA
33.9
Math
66.0
LiveCodeBench
12.6
HumanEval
No data yet
Reason
No data yet
ARC-AGI
No data yet
Coverage AVG
37.6
Cadle Cap ranks models with within-benchmark percentiles so ARC-AGI ~40 and MMLU ~90 never compete raw. Coverage AVG is an importance-weighted mean of filled expert cells only — blanks are skipped, not zeroed.
ANALYSIS · TRUTH CENTER
Hard benches (GPQA · ARC-AGI · LCB · Agentic) sit left — a mid-40 on ARC-AGI can still be frontier. Broader benches on the right are easier and often higher.
NOT RANKED YET
We only rank a model once it has enough published benchmark results to compare fairly. Everything below is what we do know: pricing, news and any scores that have been published.
DESCRIPTION + DETAILS
PROVIDER
Alibaba
RELEASE
2024-09-19
STATUS
ACTIVE
COMMUNITY REVIEWS
OPERATOR NOTES
Quality, latency, cost, and failure modes — not marketing copy.
No reviews yet
WRITE A REVIEW
Tap a star to rate
Stored on this device · synced when signed in
No operator notes yet
First review sets the tone for how teams evaluate Qwen2.5 Coder 7B Instruct.
MODEL COMPARISON
| Metric | |
|---|---|
| Provider | Alibaba |
| Release | 2024-09-19 |
| Input / 1M | No data yet |
| Output / 1M | No data yet |
| Context | No data yet |
| Cadle Cap | 51 |
| Cap board | Unranked |
DATA PROVENANCE
Scores may use different scales — check the Benchmarks tab for source links.
- Supabase models
- Cadle public observations
SOURCE TRACKING
Evidence linked to this model — listing, hub, benchmarks, or live gateway prices.
API
Alibaba listing
MEASURED CELLS
Same Truth Center numbers as the datasheet above. Accuracy, reliability, safety, and cost scores are not invented.
AA IQ5.8
MMLU47.3
GPQA33.9
Math66
LiveCodeBench12.6