Benchmark avg
19.4
7 tracked scores
ActiveModel portfolio
Tap a star to rate
OpenAI · Released 2024-09-12 · v2024-09-12 · Closed · Context 128K tokens
Cadle Score
136.2
#160 in index
Benchmark average
8.7
Not enough benchmark results yet
Pricing
$1.10
$4.40 / 1M out
MODEL MATRIX · TRUTH CENTER CELLS
Overall
—
Intelligence
—
Coding
5.8
Reasoning
7.8
Language
64.9
Knowledge
—
Agentic
10.0
MMLU
—
GPQA
—
Math
3.0
LiveCodeBench
—
HumanEval
—
Reason
—
ARC-AGI
14.0
Coverage AVG
8.7
Cadle Cap ranks models with within-benchmark percentiles so ARC-AGI ~40 and MMLU ~90 never compete raw. Coverage AVG is an importance-weighted mean of filled expert cells only — blanks are skipped, not zeroed.
ANALYSIS · TRUTH CENTER
Hard benches (GPQA · ARC-AGI · LCB · Agentic) sit left — a mid-40 on ARC-AGI can still be frontier. Broader benches on the right are easier and often higher.
Only measured signals
Benchmark avg
19.4
7 tracked scores
Strongest signal
lech-mazur-writing
Score 64.9
Blended $/1M
$5.50
In $1.10 · Out $4.40
Value index
1.6
Quality ÷ blended $/1M (higher is better)
Context
128K
Provider context window (not max output)
Coding (matrix)
5.8
Model Matrix coding cell
Agentic
10.0
Tool-use / agentic matrix cell
Measured matrix and verified gateway observations only.
PROVIDER
OpenAI
RELEASE
2024-09-12
CONTEXT
128K tokens
STATUS
ACTIVE
Real operator evaluations, prompt robustness observations, and deployment notes for o1-mini-2024-09-12.
Tested o1-mini-2024-09-12 on high-concurrency tool loops. Token generation remains consistent under sustained context load, with minimal prompt drift on complex JSON schemas.
Evaluated o1-mini-2024-09-12 on multi-turn code synthesis. Code reasoning and diff application succeed on ~88% of test suites. Best paired with strict system prompt guardrails.
| Metric | |
|---|---|
| Provider | OpenAI |
| Release | 2024-09-12 |
| Input / 1M | $1.10 |
| Output / 1M | $4.40 |
| Context | 128K tokens |
| Cadle Cap | 136 |
| Cap board | Cadle Language Cap 136 |
| aider-polyglot | 5.8 |
| arc-agi | 14.0 |
| lech-mazur-writing | 64.9 |
| frontiermath-2025-02-28-private | 3.0 |
| simplebench | 1.7 |
| cybench | 10.0 |
| weirdml | 36.3 |
Scores may use different scales — check the Benchmarks tab for source links.
Evidence linked to this model — listing, hub, benchmarks, or live gateway prices.
API
OpenAI listing
Same Truth Center numbers as the datasheet above. Accuracy, reliability, safety, and cost scores are not invented.
Source: Epoch AI (CC BY 4.0) · as of 2026-11-03 · All credits