Leaderboard
TriviaQA
triviaqaRecord
- Category
- knowledge
- Scored models
- 205
Scores
| Model | Score |
|---|---|
| deepseek-ai/DeepSeek-V4-Flash | 83.3 |
| deepseek-ai/DeepSeek-V4-Pro | 83.3 |
| — | 83.3 |
| deepseek-ai/DeepSeek-V4-Flash | 83.3 |
| deepseek-ai/DeepSeek-V4-Flash | 83.3 |
| — | 83.3 |
| deepseek-ai/DeepSeek-V4-Pro | 83.3 |
| allenai/OLMo-2-1124-7B | 81.3 |
| allenai/OLMo-2-1124-13B | 81.3 |
| allenai/OLMo-2-0325-32B | 81.3 |
| mistralai/Mistral-Small-3.1-24B-Base-2503 | 80.5 |
| mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 80.5 |
| mistralai/Mistral-Small-3.1-24B-Base-2503 | 80.5 |
| mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 80.5 |
| mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 80.5 |
| mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 80.5 |
| mistralai/Mistral-Small-3.1-24B-Base-2503 | 80.5 |
| mistralai/Mistral-Small-24B-Base-2501 | 80.32 |
| google/long-t5-tglobal-large | 78.38 |
| google/gemma-2-9b | 76.6 |
| google/gemma-2-27b | 76.6 |
| google/gemma-2-9b | 76.6 |
| google/gemma-2-27b | 76.6 |
| mistralai/Ministral-3-3B-Base-2512 | 74.9 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- knowledge
- id
- triviaqa
- name
- TriviaQA
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| DeepSeek-V4-Flash | medium | TriviaQA (EM) | deepseek-v4-flash | deepseek-ai | 1 | deepseek-ai/DeepSeek-V4-Flash | 83.3 |
| DeepSeek-V4-Pro | medium | TriviaQA (EM) | deepseek-v4-pro | deepseek-ai | 2 | deepseek-ai/DeepSeek-V4-Pro | 83.3 |
| DeepSeek-V4-Flash-DSpark | medium | TriviaQA (EM) | Unknown | deepseek-ai | 3 | — | 83.3 |
| DeepSeek-V4-Flash-GGUF | medium | TriviaQA (EM) | deepseek-v4-flash | unsloth | 4 | deepseek-ai/DeepSeek-V4-Flash | 83.3 |
| DeepSeek-V4-Flash | medium | TriviaQA (EM) | deepseek-v4-flash | unsloth | 5 | deepseek-ai/DeepSeek-V4-Flash | 83.3 |
| DeepSeek-V4-Pro-DSpark | medium | TriviaQA (EM) | Unknown | deepseek-ai | 6 | — | 83.3 |
| DeepSeek-V4-Pro | medium | TriviaQA (EM) | deepseek-v4-pro | unsloth | 7 | deepseek-ai/DeepSeek-V4-Pro | 83.3 |
| OLMo-2-1124-7B | low | Unknown | olmo-2-1124-7b | allenai | 8 | allenai/OLMo-2-1124-7B | 81.3 |
| OLMo-2-1124-13B | low | Unknown | olmo-2-1124-13b | allenai | 9 | allenai/OLMo-2-1124-13B | 81.3 |
| OLMo-2-0325-32B | low | Unknown | olmo-2-0325-32b | allenai | 10 | allenai/OLMo-2-0325-32B | 81.3 |
| Mistral-Small-3.1-24B-Instruct-2503 | low | MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | mistral-small-3-1-24b-base-2503 | mistralai | 11 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 80.5 |
| Mistral-Small-3.1-24B-Instruct-2503-GGUF | low | MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | mistral-small-3-1-24b-instruct-2503 | unsloth | 12 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 80.5 |
| Mistral-Small-3.1-24B-Base-2503 | low | MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | mistral-small-3-1-24b-base-2503 | mistralai | 13 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 80.5 |
| Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low | MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | mistral-small-3-1-24b-instruct-2503 | unsloth | 14 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 80.5 |
| Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low | MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | mistral-small-3-1-24b-instruct-2503 | unsloth | 15 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 80.5 |
| Mistral-Small-3.1-24B-Instruct-2503 | low | MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | mistral-small-3-1-24b-instruct-2503 | unsloth | 16 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 80.5 |
| Mistral-Small-3.1-24B-Instruct-2503-GGUF | low | MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | mistral-small-3-1-24b-base-2503 | Mungert | 17 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 80.5 |
| Mistral-Small-24B-Base-2501 | medium | [TriviaQA][] | mistral-small-24b-base-2501 | mistralai | 18 | mistralai/Mistral-Small-24B-Base-2501 | 80.32 |
| long-t5-tglobal-large | medium | Trivia QA (16k input) | Unknown | 19 | google/long-t5-tglobal-large | 78.38 | |
| gemma-2-9b-it | medium | [TriviaQA][] | gemma-2-9b | 20 | google/gemma-2-9b | 76.6 | |
| gemma-2-27b-it | medium | [TriviaQA][] | gemma-2-27b | 21 | google/gemma-2-27b | 76.6 | |
| gemma-2-9b | medium | [TriviaQA][] | gemma-2-9b | 22 | google/gemma-2-9b | 76.6 | |
| gemma-2-27b | medium | [TriviaQA][] | gemma-2-27b | 23 | google/gemma-2-27b | 76.6 | |
| Ministral-3-3B-Instruct-2512 | low | MATH CoT 2-Shot | ministral-3-3b-base-2512 | mistralai | 24 | mistralai/Ministral-3-3B-Base-2512 | 74.9 |
| Ministral-3-3B-Instruct-2512-BF16 | low | MATH CoT 2-Shot | ministral-3-3b-base-2512 | mistralai | 25 | mistralai/Ministral-3-3B-Base-2512 | 74.9 |
| Ministral-3-14B-Instruct-2512 | low | MATH CoT 2-Shot | ministral-3-14b-base-2512 | mistralai | 26 | mistralai/Ministral-3-14B-Base-2512 | 74.9 |
| Ministral-3-3B-Reasoning-2512 | low | MATH CoT 2-Shot | ministral-3-3b-base-2512 | mistralai | 27 | mistralai/Ministral-3-3B-Base-2512 | 74.9 |
| Ministral-3-8B-Instruct-2512 | low | MATH CoT 2-Shot | ministral-3-8b-base-2512 | mistralai | 28 | mistralai/Ministral-3-8B-Base-2512 | 74.9 |
| Ministral-3-14B-Reasoning-2512 | low | MATH CoT 2-Shot | ministral-3-14b-base-2512 | mistralai | 29 | mistralai/Ministral-3-14B-Base-2512 | 74.9 |
| Ministral-3-8B-Reasoning-2512 | low | MATH CoT 2-Shot | ministral-3-8b-base-2512 | mistralai | 30 | mistralai/Ministral-3-8B-Base-2512 | 74.9 |
| Ministral-3-3B-Reasoning-2512-GGUF | low | MATH CoT 2-Shot | ministral-3-3b-reasoning-2512 | unsloth | 31 | mistralai/Ministral-3-3B-Reasoning-2512 | 74.9 |
| Ministral-3-8B-Instruct-2512-BF16 | low | MATH CoT 2-Shot | ministral-3-8b-base-2512 | mistralai | 32 | mistralai/Ministral-3-8B-Base-2512 | 74.9 |
| Ministral-3-14B-Instruct-2512-BF16 | low | MATH CoT 2-Shot | ministral-3-14b-base-2512 | mistralai | 33 | mistralai/Ministral-3-14B-Base-2512 | 74.9 |
| Ministral-3-3B-Instruct-2512-GGUF | low | MATH CoT 2-Shot | ministral-3-3b-base-2512 | unsloth | 34 | mistralai/Ministral-3-3B-Instruct-2512 | 74.9 |
| Ministral-3-8B-Instruct-2512-GGUF | low | MATH CoT 2-Shot | ministral-3-8b-instruct-2512 | unsloth | 35 | mistralai/Ministral-3-8B-Instruct-2512 | 74.9 |
| Ministral-3-8B-Base-2512 | low | MATH CoT 2-Shot | ministral-3-8b-base-2512 | mistralai | 36 | mistralai/Ministral-3-8B-Base-2512 | 74.9 |
| Ministral-3-14B-Instruct-2512-GGUF | low | MATH CoT 2-Shot | ministral-3-14b-instruct-2512 | unsloth | 37 | mistralai/Ministral-3-14B-Instruct-2512 | 74.9 |
| Ministral-3-3B-Base-2512 | low | MATH CoT 2-Shot | ministral-3-3b-base-2512 | mistralai | 38 | mistralai/Ministral-3-3B-Base-2512 | 74.9 |
| Ministral-3-14B-Reasoning-2512-GGUF | low | MATH CoT 2-Shot | ministral-3-14b-reasoning-2512 | unsloth | 39 | mistralai/Ministral-3-14B-Reasoning-2512 | 74.9 |
| Ministral-3-14B-Base-2512 | low | MATH CoT 2-Shot | ministral-3-14b-base-2512 | mistralai | 40 | mistralai/Ministral-3-14B-Base-2512 | 74.9 |
| Ministral-3-8B-Reasoning-2512-GGUF | low | MATH CoT 2-Shot | ministral-3-8b-reasoning-2512 | unsloth | 41 | mistralai/Ministral-3-8B-Reasoning-2512 | 74.9 |
| Ministral-3-3B-Instruct-2512-unsloth-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-3b-base-2512 | unsloth | 42 | mistralai/Ministral-3-3B-Instruct-2512 | 74.9 |
| Ministral-3-3B-Reasoning-2512 | low | MATH CoT 2-Shot | ministral-3-3b-reasoning-2512 | unsloth | 43 | mistralai/Ministral-3-3B-Reasoning-2512 | 74.9 |
| Ministral-3-8B-Instruct-2512-unsloth-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-8b-instruct-2512 | unsloth | 44 | mistralai/Ministral-3-8B-Instruct-2512 | 74.9 |
| Ministral-3-8B-Instruct-2512 | low | MATH CoT 2-Shot | ministral-3-8b-instruct-2512 | unsloth | 45 | mistralai/Ministral-3-8B-Instruct-2512 | 74.9 |
| Ministral-3-3B-Instruct-2512 | low | MATH CoT 2-Shot | ministral-3-3b-base-2512 | unsloth | 46 | mistralai/Ministral-3-3B-Instruct-2512 | 74.9 |
| Ministral-3-14B-Instruct-2512-unsloth-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-14b-instruct-2512 | unsloth | 47 | mistralai/Ministral-3-14B-Instruct-2512 | 74.9 |
| Ministral-3-14B-Instruct-2512-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-14b-instruct-2512 | unsloth | 48 | mistralai/Ministral-3-14B-Instruct-2512 | 74.9 |
| Ministral-3-14B-Instruct-2512 | low | MATH CoT 2-Shot | ministral-3-14b-instruct-2512 | unsloth | 49 | mistralai/Ministral-3-14B-Instruct-2512 | 74.9 |
| Ministral-3-3B-Base-2512 | low | MATH CoT 2-Shot | ministral-3-3b-base-2512 | unsloth | 50 | mistralai/Ministral-3-3B-Base-2512 | 74.9 |
| Ministral-3-3B-Base-2512-unsloth-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-3b-base-2512 | unsloth | 51 | mistralai/Ministral-3-3B-Base-2512 | 74.9 |
| Ministral-3-14B-Reasoning-2512-unsloth-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-14b-reasoning-2512 | unsloth | 52 | mistralai/Ministral-3-14B-Reasoning-2512 | 74.9 |
| Ministral-3-14B-Instruct-2512-FP8 | low | MATH CoT 2-Shot | ministral-3-14b-instruct-2512 | unsloth | 53 | mistralai/Ministral-3-14B-Instruct-2512 | 74.9 |
| Ministral-3-3B-Reasoning-2512-unsloth-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-3b-reasoning-2512 | unsloth | 54 | mistralai/Ministral-3-3B-Reasoning-2512 | 74.9 |
| Ministral-3-3B-Instruct-2512-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-3b-base-2512 | unsloth | 55 | mistralai/Ministral-3-3B-Instruct-2512 | 74.9 |
| Ministral-3-8B-Instruct-2512-FP8 | low | MATH CoT 2-Shot | ministral-3-8b-instruct-2512 | unsloth | 56 | mistralai/Ministral-3-8B-Instruct-2512 | 74.9 |
| Ministral-3-14B-Reasoning-2512-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-14b-reasoning-2512 | unsloth | 57 | mistralai/Ministral-3-14B-Reasoning-2512 | 74.9 |
| Ministral-3-3B-Base-2512-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-3b-base-2512 | unsloth | 58 | mistralai/Ministral-3-3B-Base-2512 | 74.9 |
| Ministral-3-8B-Base-2512-unsloth-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-8b-base-2512 | unsloth | 59 | mistralai/Ministral-3-8B-Base-2512 | 74.9 |
| Ministral-3-8B-Reasoning-2512-unsloth-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-8b-reasoning-2512 | unsloth | 60 | mistralai/Ministral-3-8B-Reasoning-2512 | 74.9 |
| Ministral-3-8B-Instruct-2512-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-8b-instruct-2512 | unsloth | 61 | mistralai/Ministral-3-8B-Instruct-2512 | 74.9 |
| Ministral-3-8B-Base-2512 | low | MATH CoT 2-Shot | ministral-3-8b-base-2512 | unsloth | 62 | mistralai/Ministral-3-8B-Base-2512 | 74.9 |
| Ministral-3-8B-Reasoning-2512-GGUF | low | MATH CoT 2-Shot | ministral-3-8b-base-2512 | Mungert | 63 | mistralai/Ministral-3-8B-Base-2512 | 74.9 |
| Ministral-3-14B-Base-2512-unsloth-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-14b-base-2512 | unsloth | 64 | mistralai/Ministral-3-14B-Base-2512 | 74.9 |
| Ministral-3-14B-Reasoning-2512 | low | MATH CoT 2-Shot | ministral-3-14b-reasoning-2512 | unsloth | 65 | mistralai/Ministral-3-14B-Reasoning-2512 | 74.9 |
| Ministral-3-3B-Instruct-2512-FP8 | low | MATH CoT 2-Shot | ministral-3-3b-base-2512 | unsloth | 66 | mistralai/Ministral-3-3B-Instruct-2512 | 74.9 |
| Ministral-3-14B-Reasoning-2512-GGUF | low | MATH CoT 2-Shot | ministral-3-14b-base-2512 | Mungert | 67 | mistralai/Ministral-3-14B-Base-2512 | 74.9 |
| Ministral-3-3B-Reasoning-2512-GGUF | low | MATH CoT 2-Shot | ministral-3-3b-base-2512 | Mungert | 68 | mistralai/Ministral-3-3B-Base-2512 | 74.9 |
| Ministral-3-8B-Reasoning-2512 | low | MATH CoT 2-Shot | ministral-3-8b-reasoning-2512 | unsloth | 69 | mistralai/Ministral-3-8B-Reasoning-2512 | 74.9 |
| Ministral-3-3B-Reasoning-2512-bnb-4bit | low | MATH CoT 2-Shot | ministral-3-3b-reasoning-2512 | unsloth | 70 | mistralai/Ministral-3-3B-Reasoning-2512 | 74.9 |
| Phi-3-medium-128k-instruct | medium | TriviaQA<br>5-shot | phi-3-medium-128k-instruct | microsoft | 71 | microsoft/Phi-3-medium-128k-instruct | 73.9 |
| Phi-3-medium-4k-instruct | medium | TriviaQA<br>5-shot | phi-3-medium-4k-instruct | microsoft | 72 | microsoft/Phi-3-medium-4k-instruct | 73.9 |
| GRIN-MoE | medium | TriviaQA | grin-moe | microsoft | 73 | microsoft/GRIN-MoE | 73.9 |
| Mistral-Nemo-Instruct-2407 | medium | TriviaQA (5-shot) | mistral-nemo-base-2407 | mistralai | 74 | mistralai/Mistral-Nemo-Base-2407 | 73.8 |
| Mistral-Nemo-Base-2407 | medium | TriviaQA (5-shot) | mistral-nemo-base-2407 | mistralai | 75 | mistralai/Mistral-Nemo-Base-2407 | 73.8 |
| Mistral-Nemo-Instruct-FP8-2407 | medium | TriviaQA (5-shot) | mistral-nemo-base-2407 | mistralai | 76 | mistralai/Mistral-Nemo-Base-2407 | 73.8 |
| Phi-3-small-128k-instruct | medium | TriviaQA<br>5-shot | phi-3-small-128k-instruct | microsoft | 77 | microsoft/Phi-3-small-128k-instruct | 66 |
| Ministral-8B-Instruct-2410 | low | Unknown | ministral-8b-instruct-2410 | mistralai | 78 | mistralai/Ministral-8B-Instruct-2410 | 62.5 |
| gemma-3n-E2B-it | medium | [TriviaQA][] | gemma-3n-e4b | 79 | google/gemma-3n-E4B-it | 60.8 | |
| gemma-3n-E4B-it | medium | [TriviaQA][] | gemma-3n-e4b | 80 | google/gemma-3n-E4B | 60.8 | |
| gemma-3n-E4B-it-litert-lm | medium | [TriviaQA][] | Unknown | 81 | google/gemma-3n-E4B-it-litert-lm | 60.8 | |
| gemma-3n-E2B-it-GGUF | medium | [TriviaQA][] | gemma-3n-e2b-it | unsloth | 82 | google/gemma-3n-E2B-it | 60.8 |
| gemma-3n-E4B-it | medium | [TriviaQA][] | gemma-3n-e4b | unsloth | 83 | google/gemma-3n-E4B-it | 60.8 |
| gemma-3n-E2B | medium | [TriviaQA][] | gemma-3n-e4b | 84 | google/gemma-3n-E4B | 60.8 | |
| gemma-3n-E2B-it-litert-lm | medium | [TriviaQA][] | Unknown | 85 | google/gemma-3n-E2B-it-litert-lm | 60.8 | |
| gemma-3n-E4B-it-GGUF | medium | [TriviaQA][] | gemma-3n-e4b | unsloth | 86 | google/gemma-3n-E4B-it | 60.8 |
| gemma-3n-E4B | medium | [TriviaQA][] | gemma-3n-e4b | 87 | google/gemma-3n-E4B | 60.8 | |
| gemma-3n-E2B-it-unsloth-bnb-4bit | medium | [TriviaQA][] | gemma-3n-e2b-it | unsloth | 88 | google/gemma-3n-E2B-it | 60.8 |
| gemma-3n-E2B-it-litert-preview-GGUF | medium | [TriviaQA][] | Unknown | unsloth | 89 | google/gemma-3n-E2B-it-litert-preview | 60.8 |
| gemma-3n-E4B-it-litert-preview-GGUF | medium | [TriviaQA][] | Unknown | unsloth | 90 | google/gemma-3n-E4B-it-litert-preview | 60.8 |
| gemma-3n-E4B-unsloth-bnb-4bit | medium | [TriviaQA][] | gemma-3n-e4b | unsloth | 91 | google/gemma-3n-E4B-it | 60.8 |
| gemma-3n-E2B-it-ONNX | medium | [TriviaQA][] | gemma-3n-e2b-it | onnx-community | 92 | google/gemma-3n-E2B-it | 60.8 |
| gemma-3n-E4B-it-GGUF | medium | [TriviaQA][] | gemma-3n-e4b | Mungert | 93 | google/gemma-3n-E4B | 60.8 |
| gemma-3n-E4B-it-absolute-heresy-MPOA-imatrix-GGUF | medium | [TriviaQA][] | gemma-3n-e4b-it-absolute-heresy-mpoa | MuXodious | 94 | MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA | 60.8 |
| gemma-3n-E4B-it-absolute-heresy-GGUF | medium | [TriviaQA][] | gemma-3n-e4b | MuXodious | 95 | google/gemma-3n-E4B-it | 60.8 |
| gemma-3n-E4B-it-absolute-heresy-MPOA-GGUF | medium | [TriviaQA][] | gemma-3n-e4b-it-absolute-heresy-mpoa | MuXodious | 96 | MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA | 60.8 |
| gemma-3n-E2B-it-GGUF | medium | [TriviaQA][] | gemma-3n-e4b | Mungert | 97 | google/gemma-3n-E4b-it | 60.8 |
| gemma-2-2b-it | medium | [TriviaQA][] | gemma-2-2b | 98 | google/gemma-2-2b | 59.4 | |
| gemma-2-2b | medium | [TriviaQA][] | gemma-2-2b | 99 | google/gemma-2-2b | 59.4 | |
| Phi-3-small-8k-instruct | medium | TriviaQA<br>5-shot | phi-3-small-8k-instruct | microsoft | 100 | microsoft/Phi-3-small-8k-instruct | 58.1 |
| gemma-1.1-2b-it | medium | [TriviaQA](https://arxiv.org/abs/1705.03551) | gemma-1-1-2b-it | 101 | google/gemma-1.1-2b-it | 53.2 | |
| gemma-2b | medium | [TriviaQA](https://arxiv.org/abs/1705.03551) | Unknown | 102 | google/gemma-2b-it-pytorch | 53.2 | |
| gemma-2b-it | medium | [TriviaQA](https://arxiv.org/abs/1705.03551) | Unknown | 103 | google/gemma-2b-it-pytorch | 53.2 | |
| gemma-7b | medium | [TriviaQA](https://arxiv.org/abs/1705.03551) | Unknown | 104 | google/gemma-7b-it-quant-pytorch | 53.2 | |
| gemma-7b-it | medium | [TriviaQA](https://arxiv.org/abs/1705.03551) | gemma-7b | 105 | google/gemma-7b | 53.2 | |
| gemma-1.1-7b-it | medium | [TriviaQA](https://arxiv.org/abs/1705.03551) | gemma-1-1-7b-it | 106 | google/gemma-1.1-7b-it | 53.2 | |
| gemma-2b-AWQ | medium | [TriviaQA](https://arxiv.org/abs/1705.03551) | Unknown | 107 | google/gemma-2b-it-pytorch | 53.2 | |
| gemma-7b | medium | [TriviaQA](https://arxiv.org/abs/1705.03551) | Unknown | alpindale | 108 | google/gemma-7b-it-quant-pytorch | 53.2 |
| gemma-2b | medium | [TriviaQA](https://arxiv.org/abs/1705.03551) | Unknown | alpindale | 109 | google/gemma-2b-it-pytorch | 53.2 |
| gemma-7b-AWQ | medium | [TriviaQA](https://arxiv.org/abs/1705.03551) | Unknown | 110 | google/gemma-7b-it-quant-pytorch | 53.2 | |
| gemma-7b-it | medium | [TriviaQA](https://arxiv.org/abs/1705.03551) | Unknown | alpindale | 111 | google/gemma-7b-it-quant-pytorch | 53.2 |
| gemma-7b-GGUF | medium | [TriviaQA](https://arxiv.org/abs/1705.03551) | Unknown | 112 | google/gemma-7b-it-quant-pytorch | 53.2 | |
| MobileLLM-Pro-base | medium | TriviaQA | mobilellm-pro-base | 113 | facebook/MobileLLM-Pro-base | 39.85 | |
| MobileLLM-Pro | medium | TriviaQA | mobilellm-pro-base | 114 | facebook/MobileLLM-Pro-base | 39.85 | |
| gemma-3-1b-it | medium | [TriviaQA][] | gemma-3-1b-pt | 115 | google/gemma-3-1b-pt | 39.8 | |
| gemma-3-4b-it | medium | [TriviaQA][] | gemma-3-4b-pt | 116 | google/gemma-3-4b-pt | 39.8 | |
| gemma-3-12b-it | medium | [TriviaQA][] | gemma-3-12b-pt | 117 | google/gemma-3-12b-pt | 39.8 | |
| gemma-3-27b-it | medium | [TriviaQA][] | gemma-3-27b-pt | 118 | google/gemma-3-27b-pt | 39.8 | |
| gemma-3-4b-it | medium | [TriviaQA][] | gemma-3-4b-pt | unsloth | 119 | google/gemma-3-4b-it | 39.8 |
| gemma-3-1b-it-GGUF | medium | [TriviaQA][] | gemma-3-1b-pt | ggml-org | 120 | google/gemma-3-1b-it | 39.8 |
| gemma-3-12b-it-qat-q4_0-unquantized | medium | [TriviaQA][] | gemma-3-12b-pt | 121 | google/gemma-3-12b-it | 39.8 | |
| gemma-3-1b-it | medium | [TriviaQA][] | gemma-3-1b-pt | unsloth | 122 | google/gemma-3-1b-it | 39.8 |
| gemma-3-12b-it-GGUF | medium | [TriviaQA][] | gemma-3-12b-pt | unsloth | 123 | google/gemma-3-12b-it | 39.8 |
| gemma-3-4b-pt | medium | [TriviaQA][] | gemma-3-4b-pt | 124 | google/gemma-3-4b-pt | 39.8 | |
| gemma-3-12b-it-qat-GGUF | medium | [TriviaQA][] | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 125 | google/gemma-3-12b-it-qat-q4_0-unquantized | 39.8 |
| gemma-3-27b-it | medium | [TriviaQA][] | gemma-3-27b-it | unsloth | 126 | google/gemma-3-27b-it | 39.8 |
| gemma-3-1b-pt | medium | [TriviaQA][] | gemma-3-1b-pt | 127 | google/gemma-3-1b-pt | 39.8 | |
| gemma-3-4b-it-GGUF | medium | [TriviaQA][] | gemma-3-4b-pt | ggml-org | 128 | google/gemma-3-4b-it | 39.8 |
| gemma-3-4b-it-GGUF | medium | [TriviaQA][] | gemma-3-4b-pt | unsloth | 129 | google/gemma-3-4b-it | 39.8 |
| gemma-3-1b-it-GGUF | medium | [TriviaQA][] | gemma-3-1b-pt | unsloth | 130 | google/gemma-3-1b-it | 39.8 |
| gemma-3-12b-pt | medium | [TriviaQA][] | Unknown | 131 | google/gemma-3-12b | 39.8 | |
| gemma-3-12b-it-unsloth-bnb-4bit | medium | [TriviaQA][] | gemma-3-12b-pt | unsloth | 132 | google/gemma-3-12b-it | 39.8 |
| gemma-3-4b-it-unsloth-bnb-4bit | medium | [TriviaQA][] | gemma-3-4b-pt | unsloth | 133 | google/gemma-3-4b-it | 39.8 |
| gemma-3-12b-it | medium | [TriviaQA][] | gemma-3-12b-pt | unsloth | 134 | google/gemma-3-12b-pt | 39.8 |
| gemma-3-27b-it-GGUF | medium | [TriviaQA][] | gemma-3-27b-it | unsloth | 135 | google/gemma-3-27b-it | 39.8 |
| gemma-3-1b-it-unsloth-bnb-4bit | medium | [TriviaQA][] | gemma-3-1b-pt | unsloth | 136 | google/gemma-3-1b-it | 39.8 |
| gemma-3-4b-it-bnb-4bit | medium | [TriviaQA][] | gemma-3-4b-pt | unsloth | 137 | google/gemma-3-4b-it | 39.8 |
| gemma-3-4b-pt | medium | [TriviaQA][] | gemma-3-4b-pt | unsloth | 138 | google/gemma-3-4b-pt | 39.8 |
| gemma-3-27b-pt | medium | [TriviaQA][] | gemma-3-27b-pt | 139 | google/gemma-3-27b-pt | 39.8 | |
| gemma-3-12b-it-bnb-4bit | medium | [TriviaQA][] | gemma-3-12b-pt | unsloth | 140 | google/gemma-3-12b-it | 39.8 |
| gemma-3-27b-it-GGUF | medium | [TriviaQA][] | gemma-3-27b-it | ggml-org | 141 | google/gemma-3-27b-it | 39.8 |
| gemma-3-12b-pt | medium | [TriviaQA][] | gemma-3-12b-pt | unsloth | 142 | google/gemma-3-12b-pt | 39.8 |
| gemma-3-27b-it-bnb-4bit | medium | [TriviaQA][] | gemma-3-27b-it | unsloth | 143 | google/gemma-3-27b-it | 39.8 |
| gemma-3-27b-it-unsloth-bnb-4bit | medium | [TriviaQA][] | gemma-3-27b-it | unsloth | 144 | google/gemma-3-27b-it | 39.8 |
| gemma-3-1b-pt | medium | [TriviaQA][] | gemma-3-1b-pt | unsloth | 145 | google/gemma-3-1b-pt | 39.8 |
| gemma-3-12b-it-GGUF | medium | [TriviaQA][] | gemma-3-12b-pt | ggml-org | 146 | google/gemma-3-12b-it | 39.8 |
| gemma-3-4b-it-qat-GGUF | medium | [TriviaQA][] | gemma-3-4b-it-qat-q4-0-unquantized | unsloth | 147 | google/gemma-3-4b-it-qat-q4_0-unquantized | 39.8 |
| gemma-3-12b-it-qat-bnb-4bit | medium | [TriviaQA][] | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 148 | google/gemma-3-12b-it-qat-q4_0-unquantized | 39.8 |
| gemma-3-12b-it-qat-int4-GGUF | medium | [TriviaQA][] | gemma-3-12b-it-qat-int4-unquantized | unsloth | 149 | google/gemma-3-12b-it-qat-int4-unquantized | 39.8 |
| gemma-3-4b-it-qat-q4_0-gguf | medium | [TriviaQA][] | gemma-3-4b-pt | 150 | google/gemma-3-4b-it | 39.8 | |
| gemma-3-4b-it-qat-q4_0-unquantized | medium | [TriviaQA][] | gemma-3-4b-pt | 151 | google/gemma-3-4b-it | 39.8 | |
| gemma-3-4b-pt-bnb-4bit | medium | [TriviaQA][] | gemma-3-4b-pt | unsloth | 152 | google/gemma-3-4b-pt | 39.8 |
| gemma-3-27b-it-qat-GGUF | medium | [TriviaQA][] | gemma-3-27b-it-qat-q4-0-unquantized | unsloth | 153 | google/gemma-3-27b-it-qat-q4_0-unquantized | 39.8 |
| gemma-3-12b-it-qat-q4_0-gguf | medium | [TriviaQA][] | gemma-3-12b-pt | 154 | google/gemma-3-12b-it | 39.8 | |
| gemma-3-1b-it-bnb-4bit | medium | [TriviaQA][] | gemma-3-1b-pt | unsloth | 155 | google/gemma-3-1b-it | 39.8 |
| gemma-3-1b-it-qat-q4_0-gguf | medium | [TriviaQA][] | gemma-3-1b-pt | 156 | google/gemma-3-1b-it | 39.8 | |
| gemma-3-4b-pt-unsloth-bnb-4bit | medium | [TriviaQA][] | gemma-3-4b-pt | unsloth | 157 | google/gemma-3-4b-pt | 39.8 |
| gemma-3-12b-it-qat | medium | [TriviaQA][] | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 158 | google/gemma-3-12b-it-qat-q4_0-unquantized | 39.8 |
| gemma-3-1b-pt-unsloth-bnb-4bit | medium | [TriviaQA][] | gemma-3-1b-pt | unsloth | 159 | google/gemma-3-1b-pt | 39.8 |
| gemma-3-4b-it-FP8-Dynamic | medium | [TriviaQA][] | gemma-3-4b-pt | unsloth | 160 | google/gemma-3-4b-it | 39.8 |
| gemma-3-12b-pt-bnb-4bit | medium | [TriviaQA][] | gemma-3-12b-pt | unsloth | 161 | google/gemma-3-12b-pt | 39.8 |
| gemma-3-12b-it-qat-int4-unquantized | medium | [TriviaQA][] | gemma-3-12b-pt | 162 | google/gemma-3-12b-it | 39.8 | |
| gemma-3-27b-it-GGUF | medium | [TriviaQA][] | gemma-3-27b-pt | Mungert | 163 | google/gemma-3-27b-pt | 39.8 |
| gemma-3-27b-it-qat-q4_0-unquantized | medium | [TriviaQA][] | gemma-3-27b-it | 164 | google/gemma-3-27b-it | 39.8 | |
| gemma-3-12b-pt-unsloth-bnb-4bit | medium | [TriviaQA][] | gemma-3-12b-pt | unsloth | 165 | google/gemma-3-12b-pt | 39.8 |
| gemma-3-27b-it-qat-q4_0-gguf | medium | [TriviaQA][] | gemma-3-27b-it | 166 | google/gemma-3-27b-it | 39.8 | |
| gemma-3-27b-it-qat-q4_0-GGUF | medium | [TriviaQA][] | gemma-3-27b-it | Mungert | 167 | google/gemma-3-27b-it | 39.8 |
| gemma-3-4b-it-qat-bnb-4bit | medium | [TriviaQA][] | gemma-3-4b-it-qat-q4-0-unquantized | unsloth | 168 | google/gemma-3-4b-it-qat-q4_0-unquantized | 39.8 |
| gemma-3-1b-pt-bnb-4bit | medium | [TriviaQA][] | gemma-3-1b-pt | unsloth | 169 | google/gemma-3-1b-pt | 39.8 |
| gemma-3-27b-pt | medium | [TriviaQA][] | gemma-3-27b-pt | unsloth | 170 | google/gemma-3-27b-pt | 39.8 |
| gemma-3-12b-it-FP8-Dynamic | medium | [TriviaQA][] | gemma-3-12b-pt | unsloth | 171 | google/gemma-3-12b-pt | 39.8 |
| gemma-3-1b-it-qat-int4-unquantized | medium | [TriviaQA][] | gemma-3-1b-pt | 172 | google/gemma-3-1b-it | 39.8 | |
| gemma-3-27b-pt-bnb-4bit | medium | [TriviaQA][] | gemma-3-27b-pt | unsloth | 173 | google/gemma-3-27b-pt | 39.8 |
| gemma-3-12b-it-qat-unsloth-bnb-4bit | medium | [TriviaQA][] | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 174 | google/gemma-3-12b-it-qat-q4_0-unquantized | 39.8 |
| gemma-3-12b-pt-qat-q4_0-gguf | medium | [TriviaQA][] | gemma-3-12b-pt | 175 | google/gemma-3-12b-pt | 39.8 | |
| gemma-3-4b-it-qat | medium | [TriviaQA][] | gemma-3-4b-it-qat-q4-0-unquantized | unsloth | 176 | google/gemma-3-4b-it-qat-q4_0-unquantized | 39.8 |
| gemma-3-1b-it-qat-q4_0-unquantized | medium | [TriviaQA][] | gemma-3-1b-pt | 177 | google/gemma-3-1b-it | 39.8 | |
| gemma-3-1b-it-qat | medium | [TriviaQA][] | gemma-3-1b-it-qat-q4-0-unquantized | unsloth | 178 | google/gemma-3-1b-it-qat-q4_0-unquantized | 39.8 |
| gemma-3-27b-it-qat | medium | [TriviaQA][] | gemma-3-27b-it-qat-q4-0-unquantized | unsloth | 179 | google/gemma-3-27b-it-qat-q4_0-unquantized | 39.8 |
| gemma-3-4b-pt-qat-q4_0-gguf | medium | [TriviaQA][] | gemma-3-4b-pt | 180 | google/gemma-3-4b-pt | 39.8 | |
| bitnet-b1.58-2B-4T-gguf | medium | TriviaQA | bitnet-b1-58-2b-4t-bf16 | microsoft | 181 | microsoft/bitnet-b1.58-2B-4T-bf16 | 37.6 |
| bitnet-b1.58-2B-4T | medium | TriviaQA | bitnet-b1-58-2b-4t | microsoft | 182 | microsoft/bitnet-b1.58-2B-4T | 37.6 |
| bitnet-b1.58-2B-4T-bf16 | medium | TriviaQA | bitnet-b1-58-2b-4t-bf16 | microsoft | 183 | microsoft/bitnet-b1.58-2B-4T-bf16 | 37.6 |
| SmolLM2-1.7B-Instruct-GGUF | medium | TriviaQA | smollm2-1-7b | Mungert | 184 | HuggingFaceTB/SmolLM2-1.7B | 36.7 |
| SmolLM2-360M-Instruct-GGUF | medium | TriviaQA | smollm2-360m | Mungert | 185 | HuggingFaceTB/SmolLM2-360M | 16.9 |
| gemma-3-270m | medium | [TriviaQA][] | gemma-3-270m | 186 | google/gemma-3-270m | 15.4 | |
| gemma-3-270m-it | medium | [TriviaQA][] | gemma-3-270m | 187 | google/gemma-3-270m | 15.4 | |
| gemma-3-270m-it-GGUF | medium | [TriviaQA][] | gemma-3-270m-it | unsloth | 188 | google/gemma-3-270m-it | 15.4 |
| gemma-3-270m-it | medium | [TriviaQA][] | gemma-3-270m-it | unsloth | 189 | google/gemma-3-270m-it | 15.4 |
| gemma-3-270m-it-unsloth-bnb-4bit | medium | [TriviaQA][] | gemma-3-270m-it | unsloth | 190 | google/gemma-3-270m-it | 15.4 |
| gemma-3-270m-it-qat-GGUF | medium | [TriviaQA][] | gemma-3-270m-it-qat-q4-0-unquantized | unsloth | 191 | google/gemma-3-270m-it-qat-q4_0-unquantized | 15.4 |
| gemma-3-270m | medium | [TriviaQA][] | gemma-3-270m | unsloth | 192 | google/gemma-3-270m | 15.4 |
| gemma-3-270m-unsloth-bnb-4bit | medium | [TriviaQA][] | gemma-3-270m-it | unsloth | 193 | google/gemma-3-270m-it | 15.4 |
| gemma-3-270m-it-qat-q4_0-unquantized | medium | [TriviaQA][] | gemma-3-270m-it | 194 | google/gemma-3-270m-it | 15.4 | |
| gemma-3-270m-it-bnb-4bit | medium | [TriviaQA][] | gemma-3-270m-it | unsloth | 195 | google/gemma-3-270m-it | 15.4 |
| gemma-3-270m-it-qat | medium | [TriviaQA][] | gemma-3-270m-it-qat-q4-0-unquantized | unsloth | 196 | google/gemma-3-270m-it-qat-q4_0-unquantized | 15.4 |
| gemma-3-270m-bnb-4bit | medium | [TriviaQA][] | gemma-3-270m | unsloth | 197 | google/gemma-3-270m | 15.4 |
| gemma-3-270m-qat-q4_0-unquantized | medium | [TriviaQA][] | gemma-3-270m | 198 | google/gemma-3-270m | 15.4 | |
| gemma-3-270m-it-GGUF | medium | [TriviaQA][] | gemma-3-270m | Mungert | 199 | google/gemma-3-270m | 15.4 |
| gemma-3-270m-it-torchao-FP8 | medium | [TriviaQA][] | gemma-3-270m-it | unsloth | 200 | google/gemma-3-270m-it | 15.4 |
| t5gemma-2-270m-270m | medium | [TriviaQA] | t5gemma-2-270m-270m | 201 | google/t5gemma-2-270m-270m | 14.8 | |
| t5gemma-2-4b-4b | medium | [TriviaQA] | t5gemma-2-4b-4b | 202 | google/t5gemma-2-4b-4b | 14.8 | |
| t5gemma-2-1b-1b | medium | [TriviaQA] | t5gemma-2-1b-1b | 203 | google/t5gemma-2-1b-1b | 14.8 | |
| vaultgemma-1b | medium | [TriviaQA][] | Unknown | 204 | google/vaultgemma-1b | 11.24 | |
| SmolLM2-135M-Instruct-GGUF | medium | TriviaQA | smollm2-135m | Mungert | 205 | HuggingFaceTB/SmolLM2-135M | 4.1 |
Provenance & metadata (1)
source
- kind
- leaderboard-scrape
- paths
- benchmarks/triviaqa.html