Ministral-8B
Mistral AI131K context2024-10-16
Overall Rank
#17
of 27 models
Overall Score
69.5
avg across benchmarks
Best Task
Key Information Extraction
85.7
Weakest Task
Visual QA
57.4
Benchmark Performance
OlmOCR Benchv1.0
21/27
| Overall | ArXiv Math | H&F | Long/Tiny | Multi-Col | Old Scans | Scans Math | Tables |
|---|---|---|---|---|---|---|---|
| 58.7 | 48.9 | 53.0 | 56.6 | 82.4 | 27.9 | 62.9 | 79.3 |
OmniDocBenchv1.5
16/27
| Overall | Text Edit↓ | CDM↑ | TEDS↑ | TEDS-S↑ | Read Order↓ |
|---|---|---|---|---|---|
| 78.3 | 0.157 | 83.3 | 67.1 | 73.8 | 0.125 |
IDP Core Benchv1.0
17/27
| Overall | KIE | OCR | Table | VQA |
|---|---|---|---|---|
| 71.7 | 85.7 | 67.8 | 75.9 | 57.4 |
Capability Profile
Strength Analysis
Auto-generated from benchmark scores
Strengths
- Key Information Extraction85.7
- Layout & Order85.0
Weaknesses
- Visual QA57.4
- Table Understanding74.1