Leaderboard
DocVQA
docvqaRecord
- Category
- multimodal
- Scored models
- 218
Scores
| Model | Score |
|---|---|
| Qwen/Qwen2.5-VL-32B-Instruct | 96.4 |
| Qwen/Qwen2.5-VL-32B-Instruct | 96.4 |
| Qwen/Qwen2.5-VL-32B-Instruct | 96.4 |
| Qwen/Qwen2.5-VL-32B-Instruct | 96.4 |
| Qwen/Qwen2.5-VL-32B-Instruct | 96.4 |
| Qwen/Qwen2.5-VL-72B-Instruct | 96.1 |
| Qwen/Qwen2.5-VL-7B-Instruct | 96 |
| Qwen/Qwen2.5-VL-3B-Instruct | 96 |
| Qwen/Qwen2-VL-72B-Instruct | 95.79 |
| Qwen/Qwen2-VL-72B-Instruct | 95.79 |
| Qwen/Qwen2-VL-72B-Instruct | 95.79 |
| Qwen/Qwen2.5-Omni-3B | 95.2 |
| Qwen/Qwen2.5-Omni-7B | 95.2 |
| Qwen/Qwen2.5-Omni-7B | 95.2 |
| Qwen/Qwen2.5-Omni-3B | 95.2 |
| Qwen/Qwen2.5-Omni-3B | 95.2 |
| Qwen/Qwen2.5-Omni-7B | 95.2 |
| Qwen/Qwen2.5-Omni-7B | 95.2 |
| Qwen/Qwen2.5-Omni-3B | 95.2 |
| microsoft/Mage-VL | 95.14 |
| nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 | 94.39 |
| mistralai/Mistral-Small-3.1-24B-Base-2503 | 94.08 |
| mistralai/Mistral-Small-3.1-24B-Base-2503 | 94.08 |
| mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 94.08 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- multimodal
- id
- docvqa
- name
- DocVQA
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| Qwen2.5-VL-32B-Instruct | medium | DocVQA | qwen2-5-vl-32b-instruct | Qwen | 1 | Qwen/Qwen2.5-VL-32B-Instruct | 96.4 |
| Qwen2.5-VL-32B-Instruct-GGUF | medium | DocVQA | qwen2-5-vl-32b-instruct | unsloth | 2 | Qwen/Qwen2.5-VL-32B-Instruct | 96.4 |
| Qwen2.5-VL-32B-Instruct-bnb-4bit | medium | DocVQA | qwen2-5-vl-32b-instruct | unsloth | 3 | Qwen/Qwen2.5-VL-32B-Instruct | 96.4 |
| Qwen2.5-VL-32B-Instruct-GGUF | medium | DocVQA | qwen2-5-vl-32b-instruct | Mungert | 4 | Qwen/Qwen2.5-VL-32B-Instruct | 96.4 |
| Qwen2.5-VL-32B-Instruct-unsloth-bnb-4bit | medium | DocVQA | qwen2-5-vl-32b-instruct | unsloth | 5 | Qwen/Qwen2.5-VL-32B-Instruct | 96.4 |
| Qwen2.5-VL-72B-Instruct-AWQ | high | Unknown | qwen2-5-vl-72b-instruct | Qwen | 6 | Qwen/Qwen2.5-VL-72B-Instruct | 96.1 |
| Qwen2.5-VL-7B-Instruct-AWQ | high | Unknown | qwen2-5-vl-7b-instruct | Qwen | 7 | Qwen/Qwen2.5-VL-7B-Instruct | 96 |
| Qwen2.5-VL-3B-Instruct-AWQ | high | Unknown | qwen2-5-vl-3b-instruct | Qwen | 8 | Qwen/Qwen2.5-VL-3B-Instruct | 96 |
| Qwen2-VL-72B-Instruct-AWQ | high | Unknown | qwen2-vl-72b-instruct | Qwen | 9 | Qwen/Qwen2-VL-72B-Instruct | 95.79 |
| Qwen2-VL-72B-Instruct-GPTQ-Int4 | high | Unknown | qwen2-vl-72b-instruct | Qwen | 10 | Qwen/Qwen2-VL-72B-Instruct | 95.79 |
| Qwen2-VL-72B-Instruct-GPTQ-Int8 | high | Unknown | qwen2-vl-72b-instruct | Qwen | 11 | Qwen/Qwen2-VL-72B-Instruct | 95.79 |
| Qwen2.5-Omni-3B | medium | DocVQA<sub>test</sub> | qwen2-5-omni-3b | Qwen | 12 | Qwen/Qwen2.5-Omni-3B | 95.2 |
| Qwen2.5-Omni-7B | medium | DocVQA<sub>test</sub> | qwen2-5-omni-7b | Qwen | 13 | Qwen/Qwen2.5-Omni-7B | 95.2 |
| Qwen2.5-Omni-7B-GGUF | medium | DocVQA<sub>test</sub> | qwen2-5-omni-7b | unsloth | 14 | Qwen/Qwen2.5-Omni-7B | 95.2 |
| Qwen2.5-Omni-3B-GGUF | medium | DocVQA<sub>test</sub> | qwen2-5-omni-3b | unsloth | 15 | Qwen/Qwen2.5-Omni-3B | 95.2 |
| Qwen2.5-Omni-3B-GGUF | medium | DocVQA<sub>test</sub> | qwen2-5-omni-3b | Mungert | 16 | Qwen/Qwen2.5-Omni-3B | 95.2 |
| Qwen2.5-Omni-7B | medium | DocVQA<sub>test</sub> | qwen2-5-omni-7b | unsloth | 17 | Qwen/Qwen2.5-Omni-7B | 95.2 |
| Qwen2.5-Omni-7B-GGUF | medium | DocVQA<sub>test</sub> | qwen2-5-omni-7b | Mungert | 18 | Qwen/Qwen2.5-Omni-7B | 95.2 |
| Qwen2.5-Omni-3B | medium | DocVQA<sub>test</sub> | qwen2-5-omni-3b | unsloth | 19 | Qwen/Qwen2.5-Omni-3B | 95.2 |
| Mage-VL | medium | DocVQA-val | mage-vl | microsoft | 20 | microsoft/Mage-VL | 95.14 |
| NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 | medium | DocVQA | Unknown | nvidia | 21 | nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 | 94.39 |
| Mistral-Small-3.1-24B-Instruct-2503 | low | Unknown | mistral-small-3-1-24b-base-2503 | mistralai | 22 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 94.08 |
| Mistral-Small-3.2-24B-Instruct-2506 | low | Unknown | mistral-small-3-1-24b-base-2503 | mistralai | 23 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 94.08 |
| Mistral-Small-3.2-24B-Instruct-2506-GGUF | low | Unknown | mistral-small-3-1-24b-base-2503 | unsloth | 24 | mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 94.08 |
| Mistral-Small-3.2-24B-Instruct-2506-bnb-4bit | low | Unknown | mistral-small-3-1-24b-base-2503 | unsloth | 25 | mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 94.08 |
| Mistral-Small-3.2-24B-Instruct-2506 | low | Unknown | mistral-small-3-1-24b-base-2503 | unsloth | 26 | mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 94.08 |
| Mistral-Small-3.1-24B-Instruct-2503-GGUF | low | Unknown | mistral-small-3-1-24b-instruct-2503 | unsloth | 27 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 94.08 |
| Mistral-Small-3.2-24B-Instruct-2506-unsloth-bnb-4bit | low | Unknown | mistral-small-3-1-24b-base-2503 | unsloth | 28 | mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 94.08 |
| Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low | Unknown | mistral-small-3-1-24b-instruct-2503 | unsloth | 29 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 94.08 |
| Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low | Unknown | mistral-small-3-1-24b-instruct-2503 | unsloth | 30 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 94.08 |
| Mistral-Small-3.1-24B-Instruct-2503 | low | Unknown | mistral-small-3-1-24b-instruct-2503 | unsloth | 31 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 94.08 |
| Mistral-Small-3.1-24B-Instruct-2503-GGUF | low | Unknown | mistral-small-3-1-24b-base-2503 | Mungert | 32 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 94.08 |
| Mistral-Small-3.2-24B-Instruct-2506-GGUF | low | Unknown | mistral-small-3-1-24b-base-2503 | Mungert | 33 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 94.08 |
| Mistral-Small-3.2-24B-Instruct-2506-FP8 | low | Unknown | mistral-small-3-1-24b-base-2503 | unsloth | 34 | mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 94.08 |
| Qwen2.5-VL-32B-Instruct-AWQ | high | Unknown | qwen2-5-vl-32b-instruct | Qwen | 35 | Qwen/Qwen2.5-VL-32B-Instruct | 93.91 |
| Qwen2-VL-7B-Instruct-AWQ | high | Unknown | qwen2-vl-7b-instruct | Qwen | 36 | Qwen/Qwen2-VL-7B-Instruct | 93.89 |
| Qwen2-VL-7B-Instruct-GPTQ-Int8 | high | Unknown | qwen2-vl-7b-instruct | Qwen | 37 | Qwen/Qwen2-VL-7B-Instruct | 93.89 |
| Qwen2-VL-7B-Instruct-GPTQ-Int4 | high | Unknown | qwen2-vl-7b-instruct | Qwen | 38 | Qwen/Qwen2-VL-7B-Instruct | 93.89 |
| Phi-4-multimodal-instruct | medium | DocVQA | phi-4-multimodal-instruct | microsoft | 39 | microsoft/Phi-4-multimodal-instruct | 93.2 |
| Phi-4-multimodal-instruct | medium | DocVQA | phi-4-multimodal-instruct | Lexius | 40 | microsoft/Phi-4-multimodal-instruct | 93.2 |
| Qwen2.5-VL-7B-Instruct | medium | DocVQA<sub>test</sub> | qwen2-5-vl-7b-instruct | Qwen | 41 | Qwen/Qwen2.5-VL-7B-Instruct | 93 |
| Qwen2.5-VL-7B-Instruct-GGUF | medium | DocVQA<sub>test</sub> | qwen2-5-vl-7b-instruct | unsloth | 42 | Qwen/Qwen2.5-VL-7B-Instruct | 93 |
| Qwen2.5-VL-7B-Instruct | medium | DocVQA<sub>test</sub> | qwen2-5-vl-7b-instruct | unsloth | 43 | Qwen/Qwen2.5-VL-7B-Instruct | 93 |
| Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit | medium | DocVQA<sub>test</sub> | qwen2-5-vl-7b-instruct | unsloth | 44 | Qwen/Qwen2.5-VL-7B-Instruct | 93 |
| Qwen2.5-VL-7B-Instruct-bnb-4bit | medium | DocVQA<sub>test</sub> | qwen2-5-vl-7b-instruct | unsloth | 45 | Qwen/Qwen2.5-VL-7B-Instruct | 93 |
| Qwen2.5-VL-7B-Instruct-GGUF | medium | DocVQA<sub>test</sub> | qwen2-5-vl-7b-instruct | Mungert | 46 | Qwen/Qwen2.5-VL-7B-Instruct | 93 |
| Ming-Lite-Omni | medium | DocVQA_TEST | ling-lite | inclusionAI | 47 | inclusionAI/Ling-lite | 93 |
| Eagle2.5-8B | medium | DocVQA<sub>test</sub> | qwen2-5-7b-instruct | nvidia | 48 | Qwen/Qwen2.5-7B-Instruct | 92.8 |
| Qianfan-OCR-GGUF | medium | DocVQA | Unknown | Mungert | 49 | — | 92.8 |
| NVLM-D-72B | low | Unknown | nvlm-d-72b | nvidia | 50 | nvidia/NVLM-D-72B | 92.6 |
| Pixtral-Large-Instruct-2411 | low | MathVista (CoT) | MMMU (CoT) | ChartQA (CoT) | Unknown | mistralai | 51 | mistralai/Pixtral-Large-Instruct-2411 | 92.3 |
| Qwen2.5-VL-3B-Instruct | medium | DocVQA<sub>test</sub> | qwen2-5-vl-3b-instruct | Qwen | 52 | Qwen/Qwen2.5-VL-3B-Instruct | 91.6 |
| Qwen2-VL-7B-Instruct | medium | DocVQA<sub>test</sub> | qwen2-vl-7b | Qwen | 53 | Qwen/Qwen2-VL-7B | 91.6 |
| Qwen2.5-VL-3B-Instruct-unsloth-bnb-4bit | medium | DocVQA<sub>test</sub> | qwen2-5-vl-3b-instruct | unsloth | 54 | Qwen/Qwen2.5-VL-3B-Instruct | 91.6 |
| Qwen2.5-VL-3B-Instruct-GGUF | medium | DocVQA<sub>test</sub> | qwen2-5-vl-3b-instruct | unsloth | 55 | Qwen/Qwen2.5-VL-3B-Instruct | 91.6 |
| Qwen2.5-VL-3B-Instruct-GGUF | medium | DocVQA<sub>test</sub> | qwen2-5-vl-3b-instruct | Mungert | 56 | Qwen/Qwen2.5-VL-3B-Instruct | 91.6 |
| Qwen2-VL-7B-Instruct-unsloth-bnb-4bit | medium | DocVQA<sub>test</sub> | qwen2-vl-7b-instruct | unsloth | 57 | Qwen/Qwen2-VL-7B-Instruct | 91.6 |
| Qwen2.5-VL-3B-Instruct-bnb-4bit | medium | DocVQA<sub>test</sub> | qwen2-5-vl-3b-instruct | unsloth | 58 | Qwen/Qwen2.5-VL-3B-Instruct | 91.6 |
| Qwen2.5-VL-3B-Instruct | medium | DocVQA<sub>test</sub> | qwen2-5-vl-3b-instruct | unsloth | 59 | Qwen/Qwen2.5-VL-3B-Instruct | 91.6 |
| Qwen2-VL-7B-Instruct-bnb-4bit | medium | DocVQA<sub>test</sub> | qwen2-vl-7b-instruct | unsloth | 60 | Qwen/Qwen2-VL-7B-Instruct | 91.6 |
| Qwen2-VL-7B-Instruct | medium | DocVQA<sub>test</sub> | qwen2-vl-7b-instruct | unsloth | 61 | Qwen/Qwen2-VL-7B-Instruct | 91.6 |
| Llama-3.1-Nemotron-Nano-VL-8B-V1 | medium | DocVQA val | Unknown | nvidia | 62 | nvidia/Llama-3.1-Nemotron-Nano-VL-8B-V1 | 91.2 |
| Qwen2.5-VL-72B-Instruct | medium | DocVQA_VAL | qwen2-5-vl-72b-instruct | Qwen | 63 | Qwen/Qwen2.5-VL-72B-Instruct | 91.1 |
| MiniMax-VL-01 | medium | DocVQA<sup>*</sup> | minimax-vl-01 | MiniMaxAI | 64 | MiniMaxAI/MiniMax-VL-01 | 91.1 |
| Qwen2.5-VL-72B-Instruct-GGUF | medium | DocVQA_VAL | qwen2-5-vl-72b-instruct | unsloth | 65 | Qwen/Qwen2.5-VL-72B-Instruct | 91.1 |
| Qwen2.5-VL-72B-Instruct-GGUF | medium | DocVQA_VAL | qwen2-5-vl-72b-instruct | Mungert | 66 | Qwen/Qwen2.5-VL-72B-Instruct | 91.1 |
| Qwen2.5-VL-72B-Instruct-bnb-4bit | medium | DocVQA_VAL | qwen2-5-vl-72b-instruct | unsloth | 67 | Qwen/Qwen2.5-VL-72B-Instruct | 91.1 |
| Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bit | medium | DocVQA_VAL | qwen2-5-vl-72b-instruct | unsloth | 68 | Qwen/Qwen2.5-VL-72B-Instruct | 91.1 |
| Pixtral-12B-2409 | medium | **DocVQA** *(ANLS)* | Unknown | mistralai | 69 | mistralai/Pixtral-12B-Base-2409 | 90.7 |
| Perception-LM-1B | low | Unknown | Unknown | 70 | facebook/Perception-LM-1B | 90.7 | |
| Perception-LM-8B | low | Unknown | Unknown | 71 | facebook/Perception-LM-8B | 90.7 | |
| jina-vlm | low | Unknown | qwen3-1-7b-base | jinaai | 72 | Qwen/Qwen3-1.7B-Base | 90.6 |
| Mage-VL | medium | MultiDocVQA-val | mage-vl | microsoft | 73 | microsoft/Mage-VL | 87.46 |
| Phi-4-multimodal-instruct | medium | s_DocVQA | phi-4-multimodal-instruct | microsoft | 74 | microsoft/Phi-4-multimodal-instruct | 87.3 |
| Phi-4-multimodal-instruct | medium | s_DocVQA | phi-4-multimodal-instruct | Lexius | 75 | microsoft/Phi-4-multimodal-instruct | 87.3 |
| Qwen2-VL-2B-Instruct | medium | DocVQA<sub>test</sub> | Unknown | Qwen | 76 | Qwen/Qwen2-VL-2B | 86.9 |
| Eagle2-2B | medium | DocVQA<sub>test</sub> | paligemma-3b-mix-448 | nvidia | 77 | google/paligemma-3b-mix-448 | 86.9 |
| Qwen2-VL-2B-Instruct-unsloth-bnb-4bit | medium | DocVQA<sub>test</sub> | qwen2-vl-2b-instruct | unsloth | 78 | Qwen/Qwen2-VL-2B-Instruct | 86.9 |
| Qwen2-VL-2B-Instruct-bnb-4bit | medium | DocVQA<sub>test</sub> | qwen2-vl-2b-instruct | unsloth | 79 | Qwen/Qwen2-VL-2B-Instruct | 86.9 |
| Qwen2-VL-2B-Instruct | medium | DocVQA<sub>test</sub> | qwen2-vl-2b-instruct | unsloth | 80 | Qwen/Qwen2-VL-2B-Instruct | 86.9 |
| Eagle2-2B-GGUF | medium | DocVQA<sub>test</sub> | paligemma-3b-mix-448 | Mungert | 81 | google/paligemma-3b-mix-448 | 86.9 |
| Qwen2-VL-72B-Instruct-bnb-4bit | medium | DocVQA<sub>test</sub> | qwen2-vl-72b-instruct | unsloth | 82 | Qwen/Qwen2-VL-72B-Instruct | 86.9 |
| Qwen2-VL-72B-Instruct | medium | DocVQA<sub>test</sub> | qwen2-vl-72b-instruct | unsloth | 83 | Qwen/Qwen2-VL-72B-Instruct | 86.9 |
| PE-Lang-G14-448 | low | Unknown | Unknown | 84 | facebook/PE-Lang-G14-448 | 81.9 | |
| SmolVLM-Instruct-GGUF | high | Unknown | Unknown | Mungert | 85 | HuggingFaceTB/SmolLM2-1.7B-Instruct | 81.6 |
| cogvlm2-llama3-chat-19B | low | Open Source | cogvlm2-llama3-chat-19b | zai-org | 86 | zai-org/cogvlm2-llama3-chat-19B | 78.2 |
| cogvlm2-llama3-chinese-chat-19B | low | Open Source | Unknown | zai-org | 87 | zai-org/cogvlm2-llama3-chinese-chat-19B | 78.2 |
| cogvlm2-llama3-chat-19B-int4 | low | Open Source | cogvlm2-llama3-chat-19b | zai-org | 88 | zai-org/cogvlm2-llama3-chat-19B | 78.2 |
| gemma-3-270m | medium | [DocVQA][] | gemma-3-270m | 89 | google/gemma-3-270m | 75.8 | |
| gemma-3-270m-it | medium | [DocVQA][] | gemma-3-270m | 90 | google/gemma-3-270m | 75.8 | |
| gemma-3-270m-it-GGUF | medium | [DocVQA][] | gemma-3-270m-it | unsloth | 91 | google/gemma-3-270m-it | 75.8 |
| gemma-3-270m-it | medium | [DocVQA][] | gemma-3-270m-it | unsloth | 92 | google/gemma-3-270m-it | 75.8 |
| gemma-3-270m-it-unsloth-bnb-4bit | medium | [DocVQA][] | gemma-3-270m-it | unsloth | 93 | google/gemma-3-270m-it | 75.8 |
| gemma-3-270m-it-qat-GGUF | medium | [DocVQA][] | gemma-3-270m-it-qat-q4-0-unquantized | unsloth | 94 | google/gemma-3-270m-it-qat-q4_0-unquantized | 75.8 |
| gemma-3-270m | medium | [DocVQA][] | gemma-3-270m | unsloth | 95 | google/gemma-3-270m | 75.8 |
| gemma-3-270m-unsloth-bnb-4bit | medium | [DocVQA][] | gemma-3-270m-it | unsloth | 96 | google/gemma-3-270m-it | 75.8 |
| gemma-3-270m-it-qat-q4_0-unquantized | medium | [DocVQA][] | gemma-3-270m-it | 97 | google/gemma-3-270m-it | 75.8 | |
| gemma-3-270m-it-bnb-4bit | medium | [DocVQA][] | gemma-3-270m-it | unsloth | 98 | google/gemma-3-270m-it | 75.8 |
| gemma-3-270m-it-qat | medium | [DocVQA][] | gemma-3-270m-it-qat-q4-0-unquantized | unsloth | 99 | google/gemma-3-270m-it-qat-q4_0-unquantized | 75.8 |
| gemma-3-270m-bnb-4bit | medium | [DocVQA][] | gemma-3-270m | unsloth | 100 | google/gemma-3-270m | 75.8 |
| gemma-3-270m-qat-q4_0-unquantized | medium | [DocVQA][] | gemma-3-270m | 101 | google/gemma-3-270m | 75.8 | |
| gemma-3-270m-it-GGUF | medium | [DocVQA][] | gemma-3-270m | Mungert | 102 | google/gemma-3-270m | 75.8 |
| gemma-3-270m-it-torchao-FP8 | medium | [DocVQA][] | gemma-3-270m-it | unsloth | 103 | google/gemma-3-270m-it | 75.8 |
| gemma-3-1b-it | medium | [DocVQA][] (val) | gemma-3-1b-pt | 104 | google/gemma-3-1b-pt | 72.8 | |
| gemma-3-4b-it | medium | [DocVQA][] (val) | gemma-3-4b-pt | 105 | google/gemma-3-4b-pt | 72.8 | |
| gemma-3-270m | medium | [DocVQA][] (val) | gemma-3-270m | 106 | google/gemma-3-270m | 72.8 | |
| gemma-3-12b-it | medium | [DocVQA][] (val) | gemma-3-12b-pt | 107 | google/gemma-3-12b-pt | 72.8 | |
| gemma-3-27b-it | medium | [DocVQA][] (val) | gemma-3-27b-pt | 108 | google/gemma-3-27b-pt | 72.8 | |
| gemma-3-270m-it | medium | [DocVQA][] (val) | gemma-3-270m | 109 | google/gemma-3-270m | 72.8 | |
| gemma-3-4b-it | medium | [DocVQA][] (val) | gemma-3-4b-pt | unsloth | 110 | google/gemma-3-4b-it | 72.8 |
| gemma-3-1b-it-GGUF | medium | [DocVQA][] (val) | gemma-3-1b-pt | ggml-org | 111 | google/gemma-3-1b-it | 72.8 |
| gemma-3-12b-it-qat-q4_0-unquantized | medium | [DocVQA][] (val) | gemma-3-12b-pt | 112 | google/gemma-3-12b-it | 72.8 | |
| gemma-3-1b-it | medium | [DocVQA][] (val) | gemma-3-1b-pt | unsloth | 113 | google/gemma-3-1b-it | 72.8 |
| gemma-3-270m-it-GGUF | medium | [DocVQA][] (val) | gemma-3-270m-it | unsloth | 114 | google/gemma-3-270m-it | 72.8 |
| gemma-3-12b-it-GGUF | medium | [DocVQA][] (val) | gemma-3-12b-pt | unsloth | 115 | google/gemma-3-12b-it | 72.8 |
| gemma-3-4b-pt | medium | [DocVQA][] (val) | gemma-3-4b-pt | 116 | google/gemma-3-4b-pt | 72.8 | |
| gemma-3-12b-it-qat-GGUF | medium | [DocVQA][] (val) | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 117 | google/gemma-3-12b-it-qat-q4_0-unquantized | 72.8 |
| gemma-3-27b-it | medium | [DocVQA][] (val) | gemma-3-27b-it | unsloth | 118 | google/gemma-3-27b-it | 72.8 |
| gemma-3-1b-pt | medium | [DocVQA][] (val) | gemma-3-1b-pt | 119 | google/gemma-3-1b-pt | 72.8 | |
| gemma-3-4b-it-GGUF | medium | [DocVQA][] (val) | gemma-3-4b-pt | ggml-org | 120 | google/gemma-3-4b-it | 72.8 |
| gemma-3-4b-it-GGUF | medium | [DocVQA][] (val) | gemma-3-4b-pt | unsloth | 121 | google/gemma-3-4b-it | 72.8 |
| gemma-3-1b-it-GGUF | medium | [DocVQA][] (val) | gemma-3-1b-pt | unsloth | 122 | google/gemma-3-1b-it | 72.8 |
| gemma-3-12b-pt | medium | [DocVQA][] (val) | Unknown | 123 | google/gemma-3-12b | 72.8 | |
| gemma-3-12b-it-unsloth-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-12b-pt | unsloth | 124 | google/gemma-3-12b-it | 72.8 |
| gemma-3-4b-it-unsloth-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-4b-pt | unsloth | 125 | google/gemma-3-4b-it | 72.8 |
| gemma-3-12b-it | medium | [DocVQA][] (val) | gemma-3-12b-pt | unsloth | 126 | google/gemma-3-12b-pt | 72.8 |
| gemma-3-270m-it | medium | [DocVQA][] (val) | gemma-3-270m-it | unsloth | 127 | google/gemma-3-270m-it | 72.8 |
| gemma-3-27b-it-GGUF | medium | [DocVQA][] (val) | gemma-3-27b-it | unsloth | 128 | google/gemma-3-27b-it | 72.8 |
| gemma-3-1b-it-unsloth-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-1b-pt | unsloth | 129 | google/gemma-3-1b-it | 72.8 |
| gemma-3-4b-it-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-4b-pt | unsloth | 130 | google/gemma-3-4b-it | 72.8 |
| gemma-3-4b-pt | medium | [DocVQA][] (val) | gemma-3-4b-pt | unsloth | 131 | google/gemma-3-4b-pt | 72.8 |
| gemma-3-27b-pt | medium | [DocVQA][] (val) | gemma-3-27b-pt | 132 | google/gemma-3-27b-pt | 72.8 | |
| gemma-3-12b-it-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-12b-pt | unsloth | 133 | google/gemma-3-12b-it | 72.8 |
| gemma-3-270m-it-unsloth-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-270m-it | unsloth | 134 | google/gemma-3-270m-it | 72.8 |
| gemma-3-27b-it-GGUF | medium | [DocVQA][] (val) | gemma-3-27b-it | ggml-org | 135 | google/gemma-3-27b-it | 72.8 |
| gemma-3-12b-pt | medium | [DocVQA][] (val) | gemma-3-12b-pt | unsloth | 136 | google/gemma-3-12b-pt | 72.8 |
| gemma-3-27b-it-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-27b-it | unsloth | 137 | google/gemma-3-27b-it | 72.8 |
| gemma-3-27b-it-unsloth-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-27b-it | unsloth | 138 | google/gemma-3-27b-it | 72.8 |
| gemma-3-1b-pt | medium | [DocVQA][] (val) | gemma-3-1b-pt | unsloth | 139 | google/gemma-3-1b-pt | 72.8 |
| gemma-3-12b-it-GGUF | medium | [DocVQA][] (val) | gemma-3-12b-pt | ggml-org | 140 | google/gemma-3-12b-it | 72.8 |
| gemma-3-4b-it-qat-GGUF | medium | [DocVQA][] (val) | gemma-3-4b-it-qat-q4-0-unquantized | unsloth | 141 | google/gemma-3-4b-it-qat-q4_0-unquantized | 72.8 |
| gemma-3-270m-it-qat-GGUF | medium | [DocVQA][] (val) | gemma-3-270m-it-qat-q4-0-unquantized | unsloth | 142 | google/gemma-3-270m-it-qat-q4_0-unquantized | 72.8 |
| gemma-3-12b-it-qat-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 143 | google/gemma-3-12b-it-qat-q4_0-unquantized | 72.8 |
| gemma-3-270m | medium | [DocVQA][] (val) | gemma-3-270m | unsloth | 144 | google/gemma-3-270m | 72.8 |
| gemma-3-12b-it-qat-int4-GGUF | medium | [DocVQA][] (val) | gemma-3-12b-it-qat-int4-unquantized | unsloth | 145 | google/gemma-3-12b-it-qat-int4-unquantized | 72.8 |
| gemma-3-4b-it-qat-q4_0-gguf | medium | [DocVQA][] (val) | gemma-3-4b-pt | 146 | google/gemma-3-4b-it | 72.8 | |
| gemma-3-4b-it-qat-q4_0-unquantized | medium | [DocVQA][] (val) | gemma-3-4b-pt | 147 | google/gemma-3-4b-it | 72.8 | |
| gemma-3-4b-pt-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-4b-pt | unsloth | 148 | google/gemma-3-4b-pt | 72.8 |
| gemma-3-27b-it-qat-GGUF | medium | [DocVQA][] (val) | gemma-3-27b-it-qat-q4-0-unquantized | unsloth | 149 | google/gemma-3-27b-it-qat-q4_0-unquantized | 72.8 |
| gemma-3-12b-it-qat-q4_0-gguf | medium | [DocVQA][] (val) | gemma-3-12b-pt | 150 | google/gemma-3-12b-it | 72.8 | |
| gemma-3-1b-it-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-1b-pt | unsloth | 151 | google/gemma-3-1b-it | 72.8 |
| gemma-3-1b-it-qat-q4_0-gguf | medium | [DocVQA][] (val) | gemma-3-1b-pt | 152 | google/gemma-3-1b-it | 72.8 | |
| gemma-3-4b-pt-unsloth-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-4b-pt | unsloth | 153 | google/gemma-3-4b-pt | 72.8 |
| gemma-3-270m-unsloth-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-270m-it | unsloth | 154 | google/gemma-3-270m-it | 72.8 |
| gemma-3-12b-it-qat | medium | [DocVQA][] (val) | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 155 | google/gemma-3-12b-it-qat-q4_0-unquantized | 72.8 |
| gemma-3-1b-pt-unsloth-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-1b-pt | unsloth | 156 | google/gemma-3-1b-pt | 72.8 |
| gemma-3-4b-it-FP8-Dynamic | medium | [DocVQA][] (val) | gemma-3-4b-pt | unsloth | 157 | google/gemma-3-4b-it | 72.8 |
| gemma-3-270m-it-qat-q4_0-unquantized | medium | [DocVQA][] (val) | gemma-3-270m-it | 158 | google/gemma-3-270m-it | 72.8 | |
| gemma-3-12b-pt-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-12b-pt | unsloth | 159 | google/gemma-3-12b-pt | 72.8 |
| gemma-3-12b-it-qat-int4-unquantized | medium | [DocVQA][] (val) | gemma-3-12b-pt | 160 | google/gemma-3-12b-it | 72.8 | |
| gemma-3-27b-it-GGUF | medium | [DocVQA][] (val) | gemma-3-27b-pt | Mungert | 161 | google/gemma-3-27b-pt | 72.8 |
| gemma-3-27b-it-qat-q4_0-unquantized | medium | [DocVQA][] (val) | gemma-3-27b-it | 162 | google/gemma-3-27b-it | 72.8 | |
| gemma-3-12b-pt-unsloth-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-12b-pt | unsloth | 163 | google/gemma-3-12b-pt | 72.8 |
| gemma-3-270m-it-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-270m-it | unsloth | 164 | google/gemma-3-270m-it | 72.8 |
| gemma-3-27b-it-qat-q4_0-gguf | medium | [DocVQA][] (val) | gemma-3-27b-it | 165 | google/gemma-3-27b-it | 72.8 | |
| gemma-3-27b-it-qat-q4_0-GGUF | medium | [DocVQA][] (val) | gemma-3-27b-it | Mungert | 166 | google/gemma-3-27b-it | 72.8 |
| gemma-3-270m-it-qat | medium | [DocVQA][] (val) | gemma-3-270m-it-qat-q4-0-unquantized | unsloth | 167 | google/gemma-3-270m-it-qat-q4_0-unquantized | 72.8 |
| gemma-3-4b-it-qat-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-4b-it-qat-q4-0-unquantized | unsloth | 168 | google/gemma-3-4b-it-qat-q4_0-unquantized | 72.8 |
| gemma-3-1b-pt-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-1b-pt | unsloth | 169 | google/gemma-3-1b-pt | 72.8 |
| gemma-3-27b-pt | medium | [DocVQA][] (val) | gemma-3-27b-pt | unsloth | 170 | google/gemma-3-27b-pt | 72.8 |
| gemma-3-12b-it-FP8-Dynamic | medium | [DocVQA][] (val) | gemma-3-12b-pt | unsloth | 171 | google/gemma-3-12b-pt | 72.8 |
| gemma-3-270m-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-270m | unsloth | 172 | google/gemma-3-270m | 72.8 |
| gemma-3-1b-it-qat-int4-unquantized | medium | [DocVQA][] (val) | gemma-3-1b-pt | 173 | google/gemma-3-1b-it | 72.8 | |
| gemma-3-27b-pt-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-27b-pt | unsloth | 174 | google/gemma-3-27b-pt | 72.8 |
| gemma-3-12b-it-qat-unsloth-bnb-4bit | medium | [DocVQA][] (val) | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 175 | google/gemma-3-12b-it-qat-q4_0-unquantized | 72.8 |
| gemma-3-270m-qat-q4_0-unquantized | medium | [DocVQA][] (val) | gemma-3-270m | 176 | google/gemma-3-270m | 72.8 | |
| gemma-3-12b-pt-qat-q4_0-gguf | medium | [DocVQA][] (val) | gemma-3-12b-pt | 177 | google/gemma-3-12b-pt | 72.8 | |
| gemma-3-270m-it-GGUF | medium | [DocVQA][] (val) | gemma-3-270m | Mungert | 178 | google/gemma-3-270m | 72.8 |
| gemma-3-4b-it-qat | medium | [DocVQA][] (val) | gemma-3-4b-it-qat-q4-0-unquantized | unsloth | 179 | google/gemma-3-4b-it-qat-q4_0-unquantized | 72.8 |
| gemma-3-270m-it-torchao-FP8 | medium | [DocVQA][] (val) | gemma-3-270m-it | unsloth | 180 | google/gemma-3-270m-it | 72.8 |
| gemma-3-1b-it-qat-q4_0-unquantized | medium | [DocVQA][] (val) | gemma-3-1b-pt | 181 | google/gemma-3-1b-it | 72.8 | |
| gemma-3-1b-it-qat | medium | [DocVQA][] (val) | gemma-3-1b-it-qat-q4-0-unquantized | unsloth | 182 | google/gemma-3-1b-it-qat-q4_0-unquantized | 72.8 |
| gemma-3-27b-it-qat | medium | [DocVQA][] (val) | gemma-3-27b-it-qat-q4-0-unquantized | unsloth | 183 | google/gemma-3-27b-it-qat-q4_0-unquantized | 72.8 |
| gemma-3-4b-pt-qat-q4_0-gguf | medium | [DocVQA][] (val) | gemma-3-4b-pt | 184 | google/gemma-3-4b-pt | 72.8 | |
| Eagle2-1B | medium | DocVQA<sub>test</sub> | paligemma-3b-mix-448 | nvidia | 185 | google/paligemma-3b-mix-448 | 70 |
| Eagle2-1B-GGUF | medium | DocVQA<sub>test</sub> | paligemma-3b-mix-448 | Mungert | 186 | google/paligemma-3b-mix-448 | 70 |
| nemotron-colembed-vl-4b-v2 | low | Unknown | Unknown | nvidia | 187 | nvidia/nemotron-colembed-vl-4b-v2 | 68.05 |
| nemotron-colembed-vl-8b-v2 | low | Unknown | Unknown | nvidia | 188 | nvidia/nemotron-colembed-vl-8b-v2 | 68.05 |
| granite-vision-3.2-2b | medium | DocVQA | Unknown | unsloth | 189 | ibm-granite/granite-vision-3.2-2b | 66 |
| omni-embed-nemotron-3b | high | Unknown | Unknown | nvidia | 190 | nvidia/omni-embed-nemotron-3b | 59.2 |
| SmolVLM-256M-Instruct-GGUF | high | Unknown | Unknown | Mungert | 191 | HuggingFaceTB/SmolLM2-135M-Instruct | 58.3 |
| t5gemma-2-270m-270m | medium | [DocVQA] (val) | t5gemma-2-270m-270m | 192 | google/t5gemma-2-270m-270m | 41.6 | |
| t5gemma-2-4b-4b | medium | [DocVQA] (val) | t5gemma-2-4b-4b | 193 | google/t5gemma-2-4b-4b | 41.6 | |
| t5gemma-2-1b-1b | medium | [DocVQA] (val) | t5gemma-2-1b-1b | 194 | google/t5gemma-2-1b-1b | 41.6 | |
| paligemma2-3b-ft-docci-448 | medium | [DocVQA][] (val) | Unknown | 195 | google/paligemma2-3b-ft-docci-448 | 39.9 | |
| paligemma2-3b-pt-448 | medium | [DocVQA][] (val) | Unknown | 196 | google/paligemma2-3b-pt-448 | 39.9 | |
| paligemma2-3b-mix-224 | medium | [DocVQA][] (val) | Unknown | 197 | google/paligemma2-3b-mix-224 | 39.9 | |
| paligemma2-3b-mix-448 | medium | [DocVQA][] (val) | Unknown | 198 | google/paligemma2-3b-mix-448 | 39.9 | |
| paligemma2-3b-pt-224 | medium | [DocVQA][] (val) | Unknown | 199 | google/paligemma2-3b-pt-224 | 39.9 | |
| paligemma2-10b-mix-448 | medium | [DocVQA][] (val) | Unknown | 200 | google/paligemma2-10b-mix-448 | 39.9 | |
| paligemma2-10b-pt-224 | medium | [DocVQA][] (val) | Unknown | 201 | google/paligemma2-10b-pt-224 | 39.9 | |
| paligemma2-3b-pt-896 | medium | [DocVQA][] (val) | Unknown | 202 | google/paligemma2-3b-pt-896 | 39.9 | |
| paligemma2-10b-mix-224 | medium | [DocVQA][] (val) | Unknown | 203 | google/paligemma2-10b-mix-224 | 39.9 | |
| paligemma2-10b-ft-docci-448 | medium | [DocVQA][] (val) | Unknown | 204 | google/paligemma2-10b-ft-docci-448 | 39.9 | |
| paligemma2-28b-pt-896 | medium | [DocVQA][] (val) | Unknown | 205 | google/paligemma2-28b-pt-896 | 39.9 | |
| paligemma2-10b-pt-448 | medium | [DocVQA][] (val) | Unknown | 206 | google/paligemma2-10b-pt-448 | 39.9 | |
| paligemma2-10b-pt-896 | medium | [DocVQA][] (val) | Unknown | 207 | google/paligemma2-10b-pt-896 | 39.9 | |
| paligemma2-28b-pt-448 | medium | [DocVQA][] (val) | Unknown | 208 | google/paligemma2-28b-pt-448 | 39.9 | |
| paligemma2-28b-mix-448 | medium | [DocVQA][] (val) | Unknown | 209 | google/paligemma2-28b-mix-448 | 39.9 | |
| paligemma2-28b-pt-224 | medium | [DocVQA][] (val) | Unknown | 210 | google/paligemma2-28b-pt-224 | 39.9 | |
| paligemma2-3b-pt-448-keras | medium | [DocVQA][] (val) | Unknown | 211 | google/paligemma2-3b-pt-448-keras | 39.9 | |
| paligemma2-3b-pt-224-keras | medium | [DocVQA][] (val) | Unknown | 212 | google/paligemma2-3b-pt-224-keras | 39.9 | |
| paligemma2-3b-pt-896-keras | medium | [DocVQA][] (val) | Unknown | 213 | google/paligemma2-3b-pt-896-keras | 39.9 | |
| paligemma2-10b-pt-448-keras | medium | [DocVQA][] (val) | Unknown | 214 | google/paligemma2-10b-pt-448-keras | 39.9 | |
| paligemma2-10b-pt-896-keras | medium | [DocVQA][] (val) | Unknown | 215 | google/paligemma2-10b-pt-896-keras | 39.9 | |
| paligemma2-10b-pt-224-keras | medium | [DocVQA][] (val) | Unknown | 216 | google/paligemma2-10b-pt-224-keras | 39.9 | |
| Nemotron-3.5-Content-Safety | medium | DocVQA | Unknown | nvidia | 217 | nvidia/Nemotron-3.5-Content-Safety | 6 |
| Nemotron-3-Content-Safety | medium | DocVQA | gemma-3-4b-pt | nvidia | 218 | google/gemma-3-4b-it | 5.8 |
Provenance & metadata (1)
source
- kind
- leaderboard-scrape
- paths
- benchmarks/docvqa.html