Leaderboard
ChartQA
chartqaRecord
- Category
- multimodal
- Scored models
- 200
Scores
| Model | Score |
|---|---|
| nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 | 89.72 |
| MiniMaxAI/MiniMax-VL-01 | 88.1 |
| — | 88.1 |
| mistralai/Pixtral-Large-Instruct-2411 | 88.1 |
| Qwen/Qwen2.5-VL-72B-Instruct | 86.7 |
| Qwen/Qwen2.5-VL-72B-Instruct | 86.7 |
| Qwen/Qwen2.5-VL-72B-Instruct | 86.7 |
| Qwen/Qwen2.5-VL-72B-Instruct | 86.7 |
| Qwen/Qwen2.5-VL-72B-Instruct | 86.7 |
| nvidia/Llama-3.1-Nemotron-Nano-VL-8B-V1 | 86.3 |
| mistralai/Mistral-Small-3.1-24B-Base-2503 | 86.24 |
| mistralai/Mistral-Small-3.1-24B-Base-2503 | 86.24 |
| mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 86.24 |
| mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 86.24 |
| mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 86.24 |
| mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 86.24 |
| mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 86.24 |
| mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 86.24 |
| mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 86.24 |
| mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 86.24 |
| mistralai/Mistral-Small-3.1-24B-Base-2503 | 86.24 |
| mistralai/Mistral-Small-3.1-24B-Base-2503 | 86.24 |
| mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 86.24 |
| nvidia/NVLM-D-72B | 86 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- multimodal
- id
- chartqa
- name
- ChartQA
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 | medium | ChartQA | Unknown | nvidia | 1 | nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 | 89.72 |
| MiniMax-VL-01 | medium | ChartQA<sup>*</sup><sub>relaxed</sub> | minimax-vl-01 | MiniMaxAI | 2 | MiniMaxAI/MiniMax-VL-01 | 88.1 |
| Qianfan-OCR-GGUF | medium | ChartQA | Unknown | Mungert | 3 | — | 88.1 |
| Pixtral-Large-Instruct-2411 | low | MathVista (CoT) | MMMU (CoT) | ChartQA (CoT) | Unknown | mistralai | 4 | mistralai/Pixtral-Large-Instruct-2411 | 88.1 |
| Qwen2.5-VL-72B-Instruct | medium | ChartQA_TEST | qwen2-5-vl-72b-instruct | Qwen | 5 | Qwen/Qwen2.5-VL-72B-Instruct | 86.7 |
| Qwen2.5-VL-72B-Instruct-GGUF | medium | ChartQA_TEST | qwen2-5-vl-72b-instruct | unsloth | 6 | Qwen/Qwen2.5-VL-72B-Instruct | 86.7 |
| Qwen2.5-VL-72B-Instruct-GGUF | medium | ChartQA_TEST | qwen2-5-vl-72b-instruct | Mungert | 7 | Qwen/Qwen2.5-VL-72B-Instruct | 86.7 |
| Qwen2.5-VL-72B-Instruct-bnb-4bit | medium | ChartQA_TEST | qwen2-5-vl-72b-instruct | unsloth | 8 | Qwen/Qwen2.5-VL-72B-Instruct | 86.7 |
| Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bit | medium | ChartQA_TEST | qwen2-5-vl-72b-instruct | unsloth | 9 | Qwen/Qwen2.5-VL-72B-Instruct | 86.7 |
| Llama-3.1-Nemotron-Nano-VL-8B-V1 | medium | ChartQA | Unknown | nvidia | 10 | nvidia/Llama-3.1-Nemotron-Nano-VL-8B-V1 | 86.3 |
| Mistral-Small-3.1-24B-Instruct-2503 | low | Unknown | mistral-small-3-1-24b-base-2503 | mistralai | 11 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 86.24 |
| Mistral-Small-3.2-24B-Instruct-2506 | low | Unknown | mistral-small-3-1-24b-base-2503 | mistralai | 12 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 86.24 |
| Mistral-Small-3.2-24B-Instruct-2506-GGUF | low | Unknown | mistral-small-3-1-24b-base-2503 | unsloth | 13 | mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 86.24 |
| Mistral-Small-3.2-24B-Instruct-2506-bnb-4bit | low | Unknown | mistral-small-3-1-24b-base-2503 | unsloth | 14 | mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 86.24 |
| Mistral-Small-3.2-24B-Instruct-2506 | low | Unknown | mistral-small-3-1-24b-base-2503 | unsloth | 15 | mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 86.24 |
| Mistral-Small-3.1-24B-Instruct-2503-GGUF | low | Unknown | mistral-small-3-1-24b-instruct-2503 | unsloth | 16 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 86.24 |
| Mistral-Small-3.2-24B-Instruct-2506-unsloth-bnb-4bit | low | Unknown | mistral-small-3-1-24b-base-2503 | unsloth | 17 | mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 86.24 |
| Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low | Unknown | mistral-small-3-1-24b-instruct-2503 | unsloth | 18 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 86.24 |
| Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low | Unknown | mistral-small-3-1-24b-instruct-2503 | unsloth | 19 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 86.24 |
| Mistral-Small-3.1-24B-Instruct-2503 | low | Unknown | mistral-small-3-1-24b-instruct-2503 | unsloth | 20 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 86.24 |
| Mistral-Small-3.1-24B-Instruct-2503-GGUF | low | Unknown | mistral-small-3-1-24b-base-2503 | Mungert | 21 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 86.24 |
| Mistral-Small-3.2-24B-Instruct-2506-GGUF | low | Unknown | mistral-small-3-1-24b-base-2503 | Mungert | 22 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 86.24 |
| Mistral-Small-3.2-24B-Instruct-2506-FP8 | low | Unknown | mistral-small-3-1-24b-base-2503 | unsloth | 23 | mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 86.24 |
| NVLM-D-72B | low | Unknown | nvlm-d-72b | nvidia | 24 | nvidia/NVLM-D-72B | 86 |
| Eagle2.5-8B | medium | ChartQA<sub>test</sub> | qwen2-5-7b-instruct | nvidia | 25 | Qwen/Qwen2.5-7B-Instruct | 85.7 |
| Qwen2.5-Omni-3B | medium | ChartQA<sub>test Avg</sub> | qwen2-5-omni-3b | Qwen | 26 | Qwen/Qwen2.5-Omni-3B | 85.3 |
| Qwen2.5-Omni-7B | medium | ChartQA<sub>test Avg</sub> | qwen2-5-omni-7b | Qwen | 27 | Qwen/Qwen2.5-Omni-7B | 85.3 |
| Qwen2.5-Omni-7B-GGUF | medium | ChartQA<sub>test Avg</sub> | qwen2-5-omni-7b | unsloth | 28 | Qwen/Qwen2.5-Omni-7B | 85.3 |
| Qwen2.5-Omni-3B-GGUF | medium | ChartQA<sub>test Avg</sub> | qwen2-5-omni-3b | unsloth | 29 | Qwen/Qwen2.5-Omni-3B | 85.3 |
| Qwen2.5-Omni-3B-GGUF | medium | ChartQA<sub>test Avg</sub> | qwen2-5-omni-3b | Mungert | 30 | Qwen/Qwen2.5-Omni-3B | 85.3 |
| Qwen2.5-Omni-7B | medium | ChartQA<sub>test Avg</sub> | qwen2-5-omni-7b | unsloth | 31 | Qwen/Qwen2.5-Omni-7B | 85.3 |
| Qwen2.5-Omni-7B-GGUF | medium | ChartQA<sub>test Avg</sub> | qwen2-5-omni-7b | Mungert | 32 | Qwen/Qwen2.5-Omni-7B | 85.3 |
| Qwen2.5-Omni-3B | medium | ChartQA<sub>test Avg</sub> | qwen2-5-omni-3b | unsloth | 33 | Qwen/Qwen2.5-Omni-3B | 85.3 |
| Ming-Lite-Omni | medium | ChartQA_TEST | ling-lite | inclusionAI | 34 | inclusionAI/Ling-lite | 85.1 |
| Mage-VL | medium | ChartQA | mage-vl | microsoft | 35 | microsoft/Mage-VL | 84.88 |
| Qwen2.5-VL-7B-Instruct | medium | ChartQA<sub>test</sub> | qwen2-5-vl-7b-instruct | Qwen | 36 | Qwen/Qwen2.5-VL-7B-Instruct | 84.8 |
| Qwen2.5-VL-7B-Instruct-GGUF | medium | ChartQA<sub>test</sub> | qwen2-5-vl-7b-instruct | unsloth | 37 | Qwen/Qwen2.5-VL-7B-Instruct | 84.8 |
| Qwen2.5-VL-7B-Instruct | medium | ChartQA<sub>test</sub> | qwen2-5-vl-7b-instruct | unsloth | 38 | Qwen/Qwen2.5-VL-7B-Instruct | 84.8 |
| Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit | medium | ChartQA<sub>test</sub> | qwen2-5-vl-7b-instruct | unsloth | 39 | Qwen/Qwen2.5-VL-7B-Instruct | 84.8 |
| Qwen2.5-VL-7B-Instruct-bnb-4bit | medium | ChartQA<sub>test</sub> | qwen2-5-vl-7b-instruct | unsloth | 40 | Qwen/Qwen2.5-VL-7B-Instruct | 84.8 |
| Qwen2.5-VL-7B-Instruct-GGUF | medium | ChartQA<sub>test</sub> | qwen2-5-vl-7b-instruct | Mungert | 41 | Qwen/Qwen2.5-VL-7B-Instruct | 84.8 |
| Qwen2-VL-7B-Instruct | medium | ChartQA<sub>test</sub> | qwen2-vl-7b | Qwen | 42 | Qwen/Qwen2-VL-7B | 83.3 |
| Phi-4-reasoning-vision-15B | medium | ChartQA_TEST | phi-4-reasoning | microsoft | 43 | microsoft/Phi-4-reasoning | 83.3 |
| Qwen2-VL-7B-Instruct-unsloth-bnb-4bit | medium | ChartQA<sub>test</sub> | qwen2-vl-7b-instruct | unsloth | 44 | Qwen/Qwen2-VL-7B-Instruct | 83.3 |
| Qwen2-VL-7B-Instruct-bnb-4bit | medium | ChartQA<sub>test</sub> | qwen2-vl-7b-instruct | unsloth | 45 | Qwen/Qwen2-VL-7B-Instruct | 83.3 |
| Qwen2-VL-7B-Instruct | medium | ChartQA<sub>test</sub> | qwen2-vl-7b-instruct | unsloth | 46 | Qwen/Qwen2-VL-7B-Instruct | 83.3 |
| jina-vlm | low | Unknown | qwen3-1-7b-base | jinaai | 47 | Qwen/Qwen3-1.7B-Base | 81.9 |
| Phi-4-multimodal-instruct | medium | ChartQA | phi-4-multimodal-instruct | microsoft | 48 | microsoft/Phi-4-multimodal-instruct | 81.4 |
| Phi-3-vision-128k-instruct | medium | ChartQA | Unknown | microsoft | 49 | microsoft/Phi-3-vision-128k-instruct | 81.4 |
| Phi-4-multimodal-instruct | medium | ChartQA | phi-4-multimodal-instruct | Lexius | 50 | microsoft/Phi-4-multimodal-instruct | 81.4 |
| Perception-LM-1B | low | Unknown | Unknown | 51 | facebook/Perception-LM-1B | 78.6 | |
| Perception-LM-8B | low | Unknown | Unknown | 52 | facebook/Perception-LM-8B | 78.6 | |
| Qwen2-VL-2B-Instruct | medium | ChartQA<sub>test</sub> | Unknown | Qwen | 53 | Qwen/Qwen2-VL-2B | 76.2 |
| Eagle2-2B | medium | ChartQA<sub>test</sub> | paligemma-3b-mix-448 | nvidia | 54 | google/paligemma-3b-mix-448 | 76.2 |
| Qwen2-VL-2B-Instruct-unsloth-bnb-4bit | medium | ChartQA<sub>test</sub> | qwen2-vl-2b-instruct | unsloth | 55 | Qwen/Qwen2-VL-2B-Instruct | 76.2 |
| Qwen2-VL-2B-Instruct-bnb-4bit | medium | ChartQA<sub>test</sub> | qwen2-vl-2b-instruct | unsloth | 56 | Qwen/Qwen2-VL-2B-Instruct | 76.2 |
| Qwen2-VL-2B-Instruct | medium | ChartQA<sub>test</sub> | qwen2-vl-2b-instruct | unsloth | 57 | Qwen/Qwen2-VL-2B-Instruct | 76.2 |
| Eagle2-2B-GGUF | medium | ChartQA<sub>test</sub> | paligemma-3b-mix-448 | Mungert | 58 | google/paligemma-3b-mix-448 | 76.2 |
| Qwen2-VL-72B-Instruct-bnb-4bit | medium | ChartQA<sub>test</sub> | qwen2-vl-72b-instruct | unsloth | 59 | Qwen/Qwen2-VL-72B-Instruct | 76.2 |
| Qwen2-VL-72B-Instruct | medium | ChartQA<sub>test</sub> | qwen2-vl-72b-instruct | unsloth | 60 | Qwen/Qwen2-VL-72B-Instruct | 76.2 |
| paligemma2-3b-ft-docci-448 | medium | [ChartQA][] (aug) | Unknown | 61 | google/paligemma2-3b-ft-docci-448 | 74.4 | |
| paligemma2-3b-pt-448 | medium | [ChartQA][] (aug) | Unknown | 62 | google/paligemma2-3b-pt-448 | 74.4 | |
| paligemma2-3b-mix-224 | medium | [ChartQA][] (aug) | Unknown | 63 | google/paligemma2-3b-mix-224 | 74.4 | |
| paligemma2-3b-mix-448 | medium | [ChartQA][] (aug) | Unknown | 64 | google/paligemma2-3b-mix-448 | 74.4 | |
| paligemma2-3b-pt-224 | medium | [ChartQA][] (aug) | Unknown | 65 | google/paligemma2-3b-pt-224 | 74.4 | |
| paligemma2-10b-mix-448 | medium | [ChartQA][] (aug) | Unknown | 66 | google/paligemma2-10b-mix-448 | 74.4 | |
| paligemma2-10b-pt-224 | medium | [ChartQA][] (aug) | Unknown | 67 | google/paligemma2-10b-pt-224 | 74.4 | |
| paligemma2-3b-pt-896 | medium | [ChartQA][] (aug) | Unknown | 68 | google/paligemma2-3b-pt-896 | 74.4 | |
| paligemma2-10b-mix-224 | medium | [ChartQA][] (aug) | Unknown | 69 | google/paligemma2-10b-mix-224 | 74.4 | |
| paligemma2-10b-ft-docci-448 | medium | [ChartQA][] (aug) | Unknown | 70 | google/paligemma2-10b-ft-docci-448 | 74.4 | |
| paligemma2-28b-pt-896 | medium | [ChartQA][] (aug) | Unknown | 71 | google/paligemma2-28b-pt-896 | 74.4 | |
| paligemma2-10b-pt-448 | medium | [ChartQA][] (aug) | Unknown | 72 | google/paligemma2-10b-pt-448 | 74.4 | |
| paligemma2-10b-pt-896 | medium | [ChartQA][] (aug) | Unknown | 73 | google/paligemma2-10b-pt-896 | 74.4 | |
| paligemma2-28b-pt-448 | medium | [ChartQA][] (aug) | Unknown | 74 | google/paligemma2-28b-pt-448 | 74.4 | |
| paligemma2-28b-mix-448 | medium | [ChartQA][] (aug) | Unknown | 75 | google/paligemma2-28b-mix-448 | 74.4 | |
| paligemma2-28b-pt-224 | medium | [ChartQA][] (aug) | Unknown | 76 | google/paligemma2-28b-pt-224 | 74.4 | |
| paligemma2-3b-pt-448-keras | medium | [ChartQA][] (aug) | Unknown | 77 | google/paligemma2-3b-pt-448-keras | 74.4 | |
| paligemma2-3b-pt-224-keras | medium | [ChartQA][] (aug) | Unknown | 78 | google/paligemma2-3b-pt-224-keras | 74.4 | |
| paligemma2-3b-pt-896-keras | medium | [ChartQA][] (aug) | Unknown | 79 | google/paligemma2-3b-pt-896-keras | 74.4 | |
| paligemma2-10b-pt-448-keras | medium | [ChartQA][] (aug) | Unknown | 80 | google/paligemma2-10b-pt-448-keras | 74.4 | |
| paligemma2-10b-pt-896-keras | medium | [ChartQA][] (aug) | Unknown | 81 | google/paligemma2-10b-pt-896-keras | 74.4 | |
| paligemma2-10b-pt-224-keras | medium | [ChartQA][] (aug) | Unknown | 82 | google/paligemma2-10b-pt-224-keras | 74.4 | |
| Phi-4-multimodal-instruct | medium | s_ChartQA | phi-4-multimodal-instruct | microsoft | 83 | microsoft/Phi-4-multimodal-instruct | 69 |
| Phi-4-multimodal-instruct | medium | s_ChartQA | phi-4-multimodal-instruct | Lexius | 84 | microsoft/Phi-4-multimodal-instruct | 69 |
| gemma-3-270m | medium | [ChartQA][] | gemma-3-270m | 85 | google/gemma-3-270m | 68.8 | |
| gemma-3-270m-it | medium | [ChartQA][] | gemma-3-270m | 86 | google/gemma-3-270m | 68.8 | |
| gemma-3-270m-it-GGUF | medium | [ChartQA][] | gemma-3-270m-it | unsloth | 87 | google/gemma-3-270m-it | 68.8 |
| gemma-3-270m-it | medium | [ChartQA][] | gemma-3-270m-it | unsloth | 88 | google/gemma-3-270m-it | 68.8 |
| gemma-3-270m-it-unsloth-bnb-4bit | medium | [ChartQA][] | gemma-3-270m-it | unsloth | 89 | google/gemma-3-270m-it | 68.8 |
| gemma-3-270m-it-qat-GGUF | medium | [ChartQA][] | gemma-3-270m-it-qat-q4-0-unquantized | unsloth | 90 | google/gemma-3-270m-it-qat-q4_0-unquantized | 68.8 |
| gemma-3-270m | medium | [ChartQA][] | gemma-3-270m | unsloth | 91 | google/gemma-3-270m | 68.8 |
| gemma-3-270m-unsloth-bnb-4bit | medium | [ChartQA][] | gemma-3-270m-it | unsloth | 92 | google/gemma-3-270m-it | 68.8 |
| gemma-3-270m-it-qat-q4_0-unquantized | medium | [ChartQA][] | gemma-3-270m-it | 93 | google/gemma-3-270m-it | 68.8 | |
| gemma-3-270m-it-bnb-4bit | medium | [ChartQA][] | gemma-3-270m-it | unsloth | 94 | google/gemma-3-270m-it | 68.8 |
| gemma-3-270m-it-qat | medium | [ChartQA][] | gemma-3-270m-it-qat-q4-0-unquantized | unsloth | 95 | google/gemma-3-270m-it-qat-q4_0-unquantized | 68.8 |
| gemma-3-270m-bnb-4bit | medium | [ChartQA][] | gemma-3-270m | unsloth | 96 | google/gemma-3-270m | 68.8 |
| gemma-3-270m-qat-q4_0-unquantized | medium | [ChartQA][] | gemma-3-270m | 97 | google/gemma-3-270m | 68.8 | |
| gemma-3-270m-it-GGUF | medium | [ChartQA][] | gemma-3-270m | Mungert | 98 | google/gemma-3-270m | 68.8 |
| gemma-3-270m-it-torchao-FP8 | medium | [ChartQA][] | gemma-3-270m-it | unsloth | 99 | google/gemma-3-270m-it | 68.8 |
| cogvlm2-llama3-chat-19B | low | Open Source | cogvlm2-llama3-chat-19b | zai-org | 100 | zai-org/cogvlm2-llama3-chat-19B | 68.3 |
| cogvlm2-llama3-chinese-chat-19B | low | Open Source | Unknown | zai-org | 101 | zai-org/cogvlm2-llama3-chinese-chat-19B | 68.3 |
| cogvlm2-llama3-chat-19B-int4 | low | Open Source | cogvlm2-llama3-chat-19b | zai-org | 102 | zai-org/cogvlm2-llama3-chat-19B | 68.3 |
| gemma-3-1b-it | medium | [ChartQA][] | gemma-3-1b-pt | 103 | google/gemma-3-1b-pt | 63.6 | |
| gemma-3-4b-it | medium | [ChartQA][] | gemma-3-4b-pt | 104 | google/gemma-3-4b-pt | 63.6 | |
| gemma-3-12b-it | medium | [ChartQA][] | gemma-3-12b-pt | 105 | google/gemma-3-12b-pt | 63.6 | |
| gemma-3-27b-it | medium | [ChartQA][] | gemma-3-27b-pt | 106 | google/gemma-3-27b-pt | 63.6 | |
| gemma-3-4b-it | medium | [ChartQA][] | gemma-3-4b-pt | unsloth | 107 | google/gemma-3-4b-it | 63.6 |
| gemma-3-1b-it-GGUF | medium | [ChartQA][] | gemma-3-1b-pt | ggml-org | 108 | google/gemma-3-1b-it | 63.6 |
| gemma-3-12b-it-qat-q4_0-unquantized | medium | [ChartQA][] | gemma-3-12b-pt | 109 | google/gemma-3-12b-it | 63.6 | |
| gemma-3-1b-it | medium | [ChartQA][] | gemma-3-1b-pt | unsloth | 110 | google/gemma-3-1b-it | 63.6 |
| gemma-3-12b-it-GGUF | medium | [ChartQA][] | gemma-3-12b-pt | unsloth | 111 | google/gemma-3-12b-it | 63.6 |
| gemma-3-4b-pt | medium | [ChartQA][] | gemma-3-4b-pt | 112 | google/gemma-3-4b-pt | 63.6 | |
| gemma-3-12b-it-qat-GGUF | medium | [ChartQA][] | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 113 | google/gemma-3-12b-it-qat-q4_0-unquantized | 63.6 |
| gemma-3-27b-it | medium | [ChartQA][] | gemma-3-27b-it | unsloth | 114 | google/gemma-3-27b-it | 63.6 |
| gemma-3-1b-pt | medium | [ChartQA][] | gemma-3-1b-pt | 115 | google/gemma-3-1b-pt | 63.6 | |
| gemma-3-4b-it-GGUF | medium | [ChartQA][] | gemma-3-4b-pt | ggml-org | 116 | google/gemma-3-4b-it | 63.6 |
| gemma-3-4b-it-GGUF | medium | [ChartQA][] | gemma-3-4b-pt | unsloth | 117 | google/gemma-3-4b-it | 63.6 |
| gemma-3-1b-it-GGUF | medium | [ChartQA][] | gemma-3-1b-pt | unsloth | 118 | google/gemma-3-1b-it | 63.6 |
| gemma-3-12b-pt | medium | [ChartQA][] | Unknown | 119 | google/gemma-3-12b | 63.6 | |
| gemma-3-12b-it-unsloth-bnb-4bit | medium | [ChartQA][] | gemma-3-12b-pt | unsloth | 120 | google/gemma-3-12b-it | 63.6 |
| gemma-3-4b-it-unsloth-bnb-4bit | medium | [ChartQA][] | gemma-3-4b-pt | unsloth | 121 | google/gemma-3-4b-it | 63.6 |
| gemma-3-12b-it | medium | [ChartQA][] | gemma-3-12b-pt | unsloth | 122 | google/gemma-3-12b-pt | 63.6 |
| gemma-3-27b-it-GGUF | medium | [ChartQA][] | gemma-3-27b-it | unsloth | 123 | google/gemma-3-27b-it | 63.6 |
| gemma-3-1b-it-unsloth-bnb-4bit | medium | [ChartQA][] | gemma-3-1b-pt | unsloth | 124 | google/gemma-3-1b-it | 63.6 |
| gemma-3-4b-it-bnb-4bit | medium | [ChartQA][] | gemma-3-4b-pt | unsloth | 125 | google/gemma-3-4b-it | 63.6 |
| gemma-3-4b-pt | medium | [ChartQA][] | gemma-3-4b-pt | unsloth | 126 | google/gemma-3-4b-pt | 63.6 |
| gemma-3-27b-pt | medium | [ChartQA][] | gemma-3-27b-pt | 127 | google/gemma-3-27b-pt | 63.6 | |
| gemma-3-12b-it-bnb-4bit | medium | [ChartQA][] | gemma-3-12b-pt | unsloth | 128 | google/gemma-3-12b-it | 63.6 |
| gemma-3-27b-it-GGUF | medium | [ChartQA][] | gemma-3-27b-it | ggml-org | 129 | google/gemma-3-27b-it | 63.6 |
| gemma-3-12b-pt | medium | [ChartQA][] | gemma-3-12b-pt | unsloth | 130 | google/gemma-3-12b-pt | 63.6 |
| gemma-3-27b-it-bnb-4bit | medium | [ChartQA][] | gemma-3-27b-it | unsloth | 131 | google/gemma-3-27b-it | 63.6 |
| gemma-3-27b-it-unsloth-bnb-4bit | medium | [ChartQA][] | gemma-3-27b-it | unsloth | 132 | google/gemma-3-27b-it | 63.6 |
| gemma-3-1b-pt | medium | [ChartQA][] | gemma-3-1b-pt | unsloth | 133 | google/gemma-3-1b-pt | 63.6 |
| gemma-3-12b-it-GGUF | medium | [ChartQA][] | gemma-3-12b-pt | ggml-org | 134 | google/gemma-3-12b-it | 63.6 |
| gemma-3-4b-it-qat-GGUF | medium | [ChartQA][] | gemma-3-4b-it-qat-q4-0-unquantized | unsloth | 135 | google/gemma-3-4b-it-qat-q4_0-unquantized | 63.6 |
| gemma-3-12b-it-qat-bnb-4bit | medium | [ChartQA][] | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 136 | google/gemma-3-12b-it-qat-q4_0-unquantized | 63.6 |
| gemma-3-12b-it-qat-int4-GGUF | medium | [ChartQA][] | gemma-3-12b-it-qat-int4-unquantized | unsloth | 137 | google/gemma-3-12b-it-qat-int4-unquantized | 63.6 |
| gemma-3-4b-it-qat-q4_0-gguf | medium | [ChartQA][] | gemma-3-4b-pt | 138 | google/gemma-3-4b-it | 63.6 | |
| gemma-3-4b-it-qat-q4_0-unquantized | medium | [ChartQA][] | gemma-3-4b-pt | 139 | google/gemma-3-4b-it | 63.6 | |
| gemma-3-4b-pt-bnb-4bit | medium | [ChartQA][] | gemma-3-4b-pt | unsloth | 140 | google/gemma-3-4b-pt | 63.6 |
| gemma-3-27b-it-qat-GGUF | medium | [ChartQA][] | gemma-3-27b-it-qat-q4-0-unquantized | unsloth | 141 | google/gemma-3-27b-it-qat-q4_0-unquantized | 63.6 |
| gemma-3-12b-it-qat-q4_0-gguf | medium | [ChartQA][] | gemma-3-12b-pt | 142 | google/gemma-3-12b-it | 63.6 | |
| gemma-3-1b-it-bnb-4bit | medium | [ChartQA][] | gemma-3-1b-pt | unsloth | 143 | google/gemma-3-1b-it | 63.6 |
| gemma-3-1b-it-qat-q4_0-gguf | medium | [ChartQA][] | gemma-3-1b-pt | 144 | google/gemma-3-1b-it | 63.6 | |
| gemma-3-4b-pt-unsloth-bnb-4bit | medium | [ChartQA][] | gemma-3-4b-pt | unsloth | 145 | google/gemma-3-4b-pt | 63.6 |
| gemma-3-12b-it-qat | medium | [ChartQA][] | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 146 | google/gemma-3-12b-it-qat-q4_0-unquantized | 63.6 |
| gemma-3-1b-pt-unsloth-bnb-4bit | medium | [ChartQA][] | gemma-3-1b-pt | unsloth | 147 | google/gemma-3-1b-pt | 63.6 |
| gemma-3-4b-it-FP8-Dynamic | medium | [ChartQA][] | gemma-3-4b-pt | unsloth | 148 | google/gemma-3-4b-it | 63.6 |
| gemma-3-12b-pt-bnb-4bit | medium | [ChartQA][] | gemma-3-12b-pt | unsloth | 149 | google/gemma-3-12b-pt | 63.6 |
| gemma-3-12b-it-qat-int4-unquantized | medium | [ChartQA][] | gemma-3-12b-pt | 150 | google/gemma-3-12b-it | 63.6 | |
| gemma-3-27b-it-GGUF | medium | [ChartQA][] | gemma-3-27b-pt | Mungert | 151 | google/gemma-3-27b-pt | 63.6 |
| gemma-3-27b-it-qat-q4_0-unquantized | medium | [ChartQA][] | gemma-3-27b-it | 152 | google/gemma-3-27b-it | 63.6 | |
| gemma-3-12b-pt-unsloth-bnb-4bit | medium | [ChartQA][] | gemma-3-12b-pt | unsloth | 153 | google/gemma-3-12b-pt | 63.6 |
| gemma-3-27b-it-qat-q4_0-gguf | medium | [ChartQA][] | gemma-3-27b-it | 154 | google/gemma-3-27b-it | 63.6 | |
| gemma-3-27b-it-qat-q4_0-GGUF | medium | [ChartQA][] | gemma-3-27b-it | Mungert | 155 | google/gemma-3-27b-it | 63.6 |
| gemma-3-4b-it-qat-bnb-4bit | medium | [ChartQA][] | gemma-3-4b-it-qat-q4-0-unquantized | unsloth | 156 | google/gemma-3-4b-it-qat-q4_0-unquantized | 63.6 |
| gemma-3-1b-pt-bnb-4bit | medium | [ChartQA][] | gemma-3-1b-pt | unsloth | 157 | google/gemma-3-1b-pt | 63.6 |
| gemma-3-27b-pt | medium | [ChartQA][] | gemma-3-27b-pt | unsloth | 158 | google/gemma-3-27b-pt | 63.6 |
| gemma-3-12b-it-FP8-Dynamic | medium | [ChartQA][] | gemma-3-12b-pt | unsloth | 159 | google/gemma-3-12b-pt | 63.6 |
| gemma-3-1b-it-qat-int4-unquantized | medium | [ChartQA][] | gemma-3-1b-pt | 160 | google/gemma-3-1b-it | 63.6 | |
| gemma-3-27b-pt-bnb-4bit | medium | [ChartQA][] | gemma-3-27b-pt | unsloth | 161 | google/gemma-3-27b-pt | 63.6 |
| gemma-3-12b-it-qat-unsloth-bnb-4bit | medium | [ChartQA][] | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 162 | google/gemma-3-12b-it-qat-q4_0-unquantized | 63.6 |
| gemma-3-12b-pt-qat-q4_0-gguf | medium | [ChartQA][] | gemma-3-12b-pt | 163 | google/gemma-3-12b-pt | 63.6 | |
| gemma-3-4b-it-qat | medium | [ChartQA][] | gemma-3-4b-it-qat-q4-0-unquantized | unsloth | 164 | google/gemma-3-4b-it-qat-q4_0-unquantized | 63.6 |
| gemma-3-1b-it-qat-q4_0-unquantized | medium | [ChartQA][] | gemma-3-1b-pt | 165 | google/gemma-3-1b-it | 63.6 | |
| gemma-3-1b-it-qat | medium | [ChartQA][] | gemma-3-1b-it-qat-q4-0-unquantized | unsloth | 166 | google/gemma-3-1b-it-qat-q4_0-unquantized | 63.6 |
| gemma-3-27b-it-qat | medium | [ChartQA][] | gemma-3-27b-it-qat-q4-0-unquantized | unsloth | 167 | google/gemma-3-27b-it-qat-q4_0-unquantized | 63.6 |
| gemma-3-4b-pt-qat-q4_0-gguf | medium | [ChartQA][] | gemma-3-4b-pt | 168 | google/gemma-3-4b-pt | 63.6 | |
| Eagle2-1B | medium | ChartQA<sub>test</sub> | paligemma-3b-mix-448 | nvidia | 169 | google/paligemma-3b-mix-448 | 61.4 |
| Eagle2-1B-GGUF | medium | ChartQA<sub>test</sub> | paligemma-3b-mix-448 | Mungert | 170 | google/paligemma-3b-mix-448 | 61.4 |
| granite-vision-3.2-2b | medium | ChartQA | Unknown | unsloth | 171 | ibm-granite/granite-vision-3.2-2b | 60 |
| SmolVLM-256M-Instruct-GGUF | high | Unknown | Unknown | Mungert | 172 | HuggingFaceTB/SmolLM2-135M-Instruct | 55.8 |
| Qianfan-OCR-GGUF | medium | ChartQAPro | Unknown | Mungert | 173 | — | 42.9 |
| paligemma2-3b-ft-docci-448 | medium | [ChartQA][] (human) | Unknown | 174 | google/paligemma2-3b-ft-docci-448 | 42 | |
| paligemma2-3b-pt-448 | medium | [ChartQA][] (human) | Unknown | 175 | google/paligemma2-3b-pt-448 | 42 | |
| paligemma2-3b-mix-224 | medium | [ChartQA][] (human) | Unknown | 176 | google/paligemma2-3b-mix-224 | 42 | |
| paligemma2-3b-mix-448 | medium | [ChartQA][] (human) | Unknown | 177 | google/paligemma2-3b-mix-448 | 42 | |
| paligemma2-3b-pt-224 | medium | [ChartQA][] (human) | Unknown | 178 | google/paligemma2-3b-pt-224 | 42 | |
| paligemma2-10b-mix-448 | medium | [ChartQA][] (human) | Unknown | 179 | google/paligemma2-10b-mix-448 | 42 | |
| paligemma2-10b-pt-224 | medium | [ChartQA][] (human) | Unknown | 180 | google/paligemma2-10b-pt-224 | 42 | |
| paligemma2-3b-pt-896 | medium | [ChartQA][] (human) | Unknown | 181 | google/paligemma2-3b-pt-896 | 42 | |
| paligemma2-10b-mix-224 | medium | [ChartQA][] (human) | Unknown | 182 | google/paligemma2-10b-mix-224 | 42 | |
| paligemma2-10b-ft-docci-448 | medium | [ChartQA][] (human) | Unknown | 183 | google/paligemma2-10b-ft-docci-448 | 42 | |
| paligemma2-28b-pt-896 | medium | [ChartQA][] (human) | Unknown | 184 | google/paligemma2-28b-pt-896 | 42 | |
| paligemma2-10b-pt-448 | medium | [ChartQA][] (human) | Unknown | 185 | google/paligemma2-10b-pt-448 | 42 | |
| paligemma2-10b-pt-896 | medium | [ChartQA][] (human) | Unknown | 186 | google/paligemma2-10b-pt-896 | 42 | |
| paligemma2-28b-pt-448 | medium | [ChartQA][] (human) | Unknown | 187 | google/paligemma2-28b-pt-448 | 42 | |
| paligemma2-28b-mix-448 | medium | [ChartQA][] (human) | Unknown | 188 | google/paligemma2-28b-mix-448 | 42 | |
| paligemma2-28b-pt-224 | medium | [ChartQA][] (human) | Unknown | 189 | google/paligemma2-28b-pt-224 | 42 | |
| paligemma2-3b-pt-448-keras | medium | [ChartQA][] (human) | Unknown | 190 | google/paligemma2-3b-pt-448-keras | 42 | |
| paligemma2-3b-pt-224-keras | medium | [ChartQA][] (human) | Unknown | 191 | google/paligemma2-3b-pt-224-keras | 42 | |
| paligemma2-3b-pt-896-keras | medium | [ChartQA][] (human) | Unknown | 192 | google/paligemma2-3b-pt-896-keras | 42 | |
| paligemma2-10b-pt-448-keras | medium | [ChartQA][] (human) | Unknown | 193 | google/paligemma2-10b-pt-448-keras | 42 | |
| paligemma2-10b-pt-896-keras | medium | [ChartQA][] (human) | Unknown | 194 | google/paligemma2-10b-pt-896-keras | 42 | |
| paligemma2-10b-pt-224-keras | medium | [ChartQA][] (human) | Unknown | 195 | google/paligemma2-10b-pt-224-keras | 42 | |
| Pixtral-12B-2409 | medium | **ChartQA** *(CoT)* | Unknown | mistralai | 196 | mistralai/Pixtral-12B-Base-2409 | 38.6 |
| Mage-VL | medium | ChartQAPro | mage-vl | microsoft | 197 | microsoft/Mage-VL | 32.57 |
| t5gemma-2-270m-270m | medium | [ChartQA] | t5gemma-2-270m-270m | 198 | google/t5gemma-2-270m-270m | 29.2 | |
| t5gemma-2-4b-4b | medium | [ChartQA] | t5gemma-2-4b-4b | 199 | google/t5gemma-2-4b-4b | 29.2 | |
| t5gemma-2-1b-1b | medium | [ChartQA] | t5gemma-2-1b-1b | 200 | google/t5gemma-2-1b-1b | 29.2 |
Provenance & metadata (1)
source
- kind
- leaderboard-scrape
- paths
- benchmarks/chartqa.html