Mistral · Released 2023-09-27 · v2023-09-27 · Open
ACTIVETextCodeReasoning
Language Cap
No data yet
language · unranked
Benchmark average
14.5
Not enough benchmark results yet
Pricing
Unlisted
no list price
CADLE CAP vs MODEL MATRIX
Cadle Cap ranks models on every published score we have for them — harder benchmarks weigh more. Missing tests are skipped, not zeroed. It answers who is stronger than whom in today's pool.
Model Matrix is the datasheet: Overall, Intelligence, Coding, Agentic, MMLU, GPQA, Math, LiveCodeBench, HumanEval, Reason, ARC-AGI. A dash means unmeasured. AVG is an importance-weighted mean of that model's filled cells only.
MODEL MATRIX · TRUTH CENTER CELLS
Overall
No data yet
Intelligence
5.0
Coding
No data yet
Agentic
No data yet
MMLU
24.5
GPQA
17.7
Math
12.1
LiveCodeBench
4.6
HumanEval
No data yet
Reason
19.9
ARC-AGI
No data yet
Coverage AVG
14.5
Cadle Cap ranks models with within-benchmark percentiles so ARC-AGI ~40 and MMLU ~90 never compete raw. Coverage AVG is an importance-weighted mean of filled expert cells only — blanks are skipped, not zeroed.
ANALYSIS · TRUTH CENTER
Hard benches (GPQA · ARC-AGI · LCB · Agentic) sit left — a mid-40 on ARC-AGI can still be frontier. Broader benches on the right are easier and often higher.
We only rank a model once it has enough published benchmark results to compare fairly. Everything below is what we do know: pricing, news and any scores that have been published.
SPEED · COST · QUALITY
Measured matrix / AA / gateway rows only.
AA / Intel index
5.0
DESCRIPTION + DETAILS
PROVIDER
Mistral
RELEASE
2023-09-27
STATUS
ACTIVE
COMMUNITY REVIEWS
OPERATOR NOTES
Quality, latency, cost, and failure modes — not marketing copy.
No reviews yet
WRITE A REVIEW
Tap a star to rate
Stored on this device · synced when signed in
No operator notes yet
First review sets the tone for how teams evaluate Mistral 7B Instruct.
MODEL COMPARISON
Metric
Mistral 7B Instruct
Provider
Mistral
Release
2023-09-27
Input / 1M
No data yet
Output / 1M
No data yet
Context
No data yet
Cadle Cap
35
Cap board
Unranked
DATA PROVENANCE
Scores may use different scales — check the Benchmarks tab for source links.
Supabase models
Cadle public observations
MEASURED CELLS
Same Truth Center numbers as the datasheet above. Accuracy, reliability, safety, and cost scores are not invented.