Gemma-3-12B-IT
Google8K context2025-03-12
Overall Rank
—
IDP benchmark pending
Overall Score
—
requires all benchmarks
Best Task
Text Extraction
52.4
Weakest Task
Key Information Extraction
0.0
Benchmark Performance
OlmOCR Benchv1.0
27/27
| Overall | ArXiv Math | H&F | Long/Tiny | Multi-Col | Old Scans | Scans Math | Tables |
|---|---|---|---|---|---|---|---|
| 20.6 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
OmniDocBenchv1.5
24/27
| Overall | Text Edit↓ | CDM↑ | TEDS↑ | TEDS-S↑ | Read Order↓ |
|---|---|---|---|---|---|
| 44.6 | 0.476 | 50.0 | 31.6 | 46.9 | 0.364 |
IDP Core Benchv1.0
25/27
| Overall | KIE | OCR | Table | VQA |
|---|---|---|---|---|
| 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
Capability Profile
Strength Analysis
Auto-generated from benchmark scores
Strengths
- Text Extraction52.4
- Formula50.0
Weaknesses
- Key Information Extraction0.0
- Visual QA0.0