Leaderboard
WinoGrande
winograndeRecord
- Category
- knowledge
- Scored models
- 294
Scores
| Model | Score |
|---|---|
| nvidia/Nemotron-4-340B-Base | 89.5 |
| allenai/Olmo-3-1125-32B | 87.5 |
| — | 87.37 |
| — | 86.35 |
| — | 85.4 |
| abideen/NexoNimbus-7B | 84.84 |
| mlabonne/OmniTruthyBeagle-7B-v0 | 84.61 |
| nvidia/Nemotron-H-56B-Base-8K | 84.45 |
| nvidia/Nemotron-H-56B-Base-8K | 83.9 |
| fblgit/UNA-TheBeagle-7b-v1 | 83.66 |
| jeonsworld/CarbonVillain-en-10.7B-v4 | 83.58 |
| VAGOsolutions/SauerkrautLM-SOLAR-Instruct | 83.5 |
| DiscoResearch/DiscoLM-70b | 83.27 |
| shadowml/BeagleSempra-7B | 83.11 |
| kyujinpy/PlatYi-34B-Llama-Q-v3 | 83.03 |
| tiiuae/Falcon-H1-34B-Base | 82.72 |
| fblgit/UNA-TheBeagle-7b-v1 | 82.64 |
| Qwen/Qwen2-57B-A14B | 82.5 |
| mlabonne/Daredevil-7B | 82.08 |
| AIDC-ai-business/Marcoroni-7B-v3 | 81.61 |
| microsoft/Phi-3-small-8k-instruct | 81.5 |
| microsoft/Phi-3-medium-4k-instruct | 81.5 |
| rwitz/go-bruins-v2 | 81.45 |
| microsoft/GRIN-MoE | 81.4 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- knowledge
- id
- winogrande
- name
- WinoGrande
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| Nemotron-4-340B-Base | low | Winogrande | Unknown | nvidia | 1 | nvidia/Nemotron-4-340B-Base | 89.5 |
| Olmo-3-1125-32B | low | Winogrande RC | olmo-3-1125-32b | allenai | 2 | allenai/Olmo-3-1125-32B | 87.5 |
| UNA-ThePitbull-21.4B-v2-GGUF | medium | Winogrande (5-shot) | Unknown | bartowski | 3 | — | 87.37 |
| UNA-ThePitbull-21.4B-v2-GGUF | medium | winogrande | Unknown | bartowski | 4 | — | 86.35 |
| c4ai-command-r-plus-GPTQ | low | Winogrande | Unknown | alpindale | 5 | — | 85.4 |
| NexoNimbus-7B-GGUF | medium | winogrande | nexonimbus-7b | TheBloke | 6 | abideen/NexoNimbus-7B | 84.84 |
| Monarch-7B | medium | Winogrande (5-shot) | omnitruthybeagle-7b-v0 | mlabonne | 7 | mlabonne/OmniTruthyBeagle-7B-v0 | 84.61 |
| Nemotron-H-56B-Base-8K | low | Winogrande 5-shot | nemotron-h-56b-base-8k | nvidia | 8 | nvidia/Nemotron-H-56B-Base-8K | 84.45 |
| Nemotron-H-47B-Base-8K | low | Winogrande 5-shot | nemotron-h-56b-base-8k | nvidia | 9 | nvidia/Nemotron-H-56B-Base-8K | 83.9 |
| UNA-TheBeagle-7B-v1-GGUF | medium | winogrande | una-thebeagle-7b-v1 | TheBloke | 10 | fblgit/UNA-TheBeagle-7b-v1 | 83.66 |
| CarbonVillain-en-10.7B-v4-GGUF | medium | Winogrande (5-shot) | carbonvillain-en-10-7b-v4 | TheBloke | 11 | jeonsworld/CarbonVillain-en-10.7B-v4 | 83.58 |
| SauerkrautLM-SOLAR-Instruct-GGUF | medium | Winogrande (5-shot) | sauerkrautlm-solar-instruct | TheBloke | 12 | VAGOsolutions/SauerkrautLM-SOLAR-Instruct | 83.5 |
| DiscoLM-70B-GGUF | medium | Winogrande (5-shot) | discolm-70b | TheBloke | 13 | DiscoResearch/DiscoLM-70b | 83.27 |
| OmniBeagle-7B | medium | Winogrande (5-shot) | beaglesempra-7b | mlabonne | 14 | shadowml/BeagleSempra-7B | 83.11 |
| PlatYi-34B-Llama-Q-v3-GGUF | high | Winogrande | platyi-34b-llama-q-v3 | TheBloke | 15 | kyujinpy/PlatYi-34B-Llama-Q-v3 | 83.03 |
| Falcon-H1-34B-Base | medium | Winogrande | falcon-h1-34b-base | tiiuae | 16 | tiiuae/Falcon-H1-34B-Base | 82.72 |
| Beagle14-7B | medium | Winogrande (5-shot) | una-thebeagle-7b-v1 | mlabonne | 17 | fblgit/UNA-TheBeagle-7b-v1 | 82.64 |
| Qwen2-57B-A14B | medium | Winogrande | qwen2-57b-a14b | Qwen | 18 | Qwen/Qwen2-57B-A14B | 82.5 |
| NeuralDaredevil-7B | medium | Winogrande (5-shot) | daredevil-7b | mlabonne | 19 | mlabonne/Daredevil-7B | 82.08 |
| Marcoro14-7B-slerp | medium | Winogrande (5-shot) | marcoro14-7b-slerp | mlabonne | 20 | AIDC-ai-business/Marcoroni-7B-v3 | 81.61 |
| Phi-3-small-8k-instruct | medium | WinoGrande<br>5-shot | phi-3-small-8k-instruct | microsoft | 21 | microsoft/Phi-3-small-8k-instruct | 81.5 |
| Phi-3-medium-4k-instruct | medium | WinoGrande<br>5-shot | phi-3-medium-4k-instruct | microsoft | 22 | microsoft/Phi-3-medium-4k-instruct | 81.5 |
| go-bruins-v2-GGUF | low | Winogrande | Unknown | TheBloke | 23 | rwitz/go-bruins-v2 | 81.45 |
| GRIN-MoE | medium | WinoGrande | grin-moe | microsoft | 24 | microsoft/GRIN-MoE | 81.4 |
| go-bruins-GGUF | low | Winogrande | Unknown | TheBloke | 25 | rwitz/go-bruins | 81.37 |
| supermario-v2-GGUF | medium | Winogrande (5-shot) | supermario-v2 | TheBloke | 26 | janhq/supermario-v2 | 81.37 |
| Daredevil-7B | medium | Winogrande (5-shot) | mistral-7b-v0-1 | mlabonne | 27 | mistralai/Mistral-7B-v0.1 | 81.29 |
| SUS-Chat-34B-GGUF | high | winogrande | Unknown | TheBloke | 28 | SUSTech/SUS-Chat-34B | 81.22 |
| una-xaberius-34b-v1beta-GGUF | low | Winogrande (5-s) | una-xaberius-34b-v1beta | TheBloke | 29 | fblgit/una-xaberius-34b-v1beta | 80.9 |
| Seraph-7B-GGUF | medium | Winogrande (5-shot) | seraph-7b | TheBloke | 30 | Weyaxi/Seraph-7B | 80.66 |
| smol-7B-GGUF | low | Winogrande | smol-7b | TheBloke | 31 | rishiraj/smol-7b | 80.66 |
| gemma-2-9b-it | medium | [WinoGrande][] | gemma-2-9b | 32 | google/gemma-2-9b | 80.6 | |
| gemma-2-27b-it | medium | [WinoGrande][] | gemma-2-27b | 33 | google/gemma-2-27b | 80.6 | |
| gemma-2-9b | medium | [WinoGrande][] | gemma-2-9b | 34 | google/gemma-2-9b | 80.6 | |
| gemma-2-27b | medium | [WinoGrande][] | gemma-2-27b | 35 | google/gemma-2-27b | 80.6 | |
| Nemotron-H-8B-Base-8K | low | Winogrande 5-shot | nemotron-h-8b-base-8k | nvidia | 36 | nvidia/Nemotron-H-8B-Base-8K | 80.51 |
| NeuralPipe-7B-ties | medium | Winogrande (5-shot) | mistral-ft-optimized-1218 | mlabonne | 37 | OpenPipe/mistral-ft-optimized-1218 | 80.19 |
| Phi-3-small-128k-instruct | medium | WinoGrande<br>5-shot | phi-3-small-128k-instruct | microsoft | 38 | microsoft/Phi-3-small-128k-instruct | 80.1 |
| Darewin-7B | medium | Winogrande (5-shot) | neural-chat-7b-v3-3 | mlabonne | 39 | Intel/neural-chat-7b-v3-3 | 79.79 |
| NeuralDarewin-7B | medium | Winogrande (5-shot) | mistral-7b-v0-1 | mlabonne | 40 | mistralai/Mistral-7B-v0.1 | 79.72 |
| neural-chat-7B-v3-3-GGUF | medium | Winogrande (5-shot) | neural-chat-7b-v3-3 | TheBloke | 41 | Intel/neural-chat-7b-v3-3 | 79.64 |
| neural-chat-7B-v3-3-GPTQ | medium | Winogrande (5-shot) | neural-chat-7b-v3-3 | TheBloke | 42 | Intel/neural-chat-7b-v3-3 | 79.64 |
| NeuralPipe-7B-slerp | medium | Winogrande (5-shot) | mistral-ft-optimized-1218 | mlabonne | 43 | OpenPipe/mistral-ft-optimized-1218 | 79.64 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | medium | WinoGrande | nvidia-nemotron-3-ultra-550b-a55b-base-bf16 | nvidia | 44 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | 79.32 |
| NVIDIA-Nemotron-Nano-9B-v2-Base | medium | WinoGrande | nvidia-nemotron-nano-9b-v2-base | nvidia | 45 | nvidia/NVIDIA-Nemotron-Nano-9B-v2-Base | 79.24 |
| NVIDIA-Nemotron-Nano-12B-v2-Base | medium | WinoGrande | nvidia-nemotron-nano-12b-v2-base | nvidia | 46 | nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base | 79.24 |
| OpenHermes-2.5-neural-chat-v3-3-Slerp-GGUF | medium | Winogrande (5-shot) | openhermes-2-5-neural-chat-v3-3-slerp | TheBloke | 47 | Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp | 79.16 |
| Nous-Hermes-2-Yi-34B-GGUF | medium | winogrande | nous-hermes-2-yi-34b | TheBloke | 48 | NousResearch/Nous-Hermes-2-Yi-34B | 79.08 |
| Nous-Hermes-2-Yi-34B-AWQ | medium | winogrande | nous-hermes-2-yi-34b | TheBloke | 49 | NousResearch/Nous-Hermes-2-Yi-34B | 79.08 |
| Falcon-H1-7B-Base | medium | Winogrande | falcon-h1-7b-base | tiiuae | 50 | tiiuae/Falcon-H1-7B-Base | 79.01 |
| NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16 | medium | WinoGrande | nvidia-nemotron-3-super-120b-a12b-base-bf16 | nvidia | 51 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16 | 78.93 |
| DeepSeek-V4-Flash | medium | WinoGrande (EM) | deepseek-v4-flash | deepseek-ai | 52 | deepseek-ai/DeepSeek-V4-Flash | 78.9 |
| DeepSeek-V4-Pro | medium | WinoGrande (EM) | deepseek-v4-pro | deepseek-ai | 53 | deepseek-ai/DeepSeek-V4-Pro | 78.9 |
| DeepSeek-V4-Flash-DSpark | medium | WinoGrande (EM) | deepseek-v4-flash | deepseek-ai | 54 | deepseek-ai/DeepSeek-V4-Flash | 78.9 |
| DeepSeek-V4-Flash-GGUF | medium | WinoGrande (EM) | deepseek-v4-flash | unsloth | 55 | deepseek-ai/DeepSeek-V4-Flash | 78.9 |
| DeepSeek-V4-Flash | medium | WinoGrande (EM) | deepseek-v4-flash | unsloth | 56 | deepseek-ai/DeepSeek-V4-Flash | 78.9 |
| DeepSeek-V4-Pro-DSpark | medium | WinoGrande (EM) | Unknown | deepseek-ai | 57 | — | 78.9 |
| Phi-3-medium-128k-instruct | medium | WinoGrande<br>5-shot | phi-3-medium-128k-instruct | microsoft | 58 | microsoft/Phi-3-medium-128k-instruct | 78.9 |
| DeepSeek-V4-Pro | medium | WinoGrande (EM) | deepseek-v4-pro | unsloth | 59 | deepseek-ai/DeepSeek-V4-Pro | 78.9 |
| loyal-piano-m7-GGUF | low | Winogrande | loyal-piano-m7 | TheBloke | 60 | chargoddard/loyal-piano-m7 | 78.85 |
| Optimus-7B-GGUF | medium | Winogrande (5-shot) | optimus-7b | TheBloke | 61 | Q-bert/Optimus-7B | 78.77 |
| Beyonder-4x7B-v2-GGUF | medium | winogrande | beyonder-4x7b-v2 | TheBloke | 62 | mlabonne/Beyonder-4x7B-v2 | 78.69 |
| Beyonder-4x7B-v2 | medium | winogrande | marcoro14-7b-slerp | mlabonne | 63 | mlabonne/Marcoro14-7B-slerp | 78.69 |
| Marcoro14-7B-slerp | medium | winogrande | marcoro14-7b-slerp | mlabonne | 64 | AIDC-ai-business/Marcoroni-7B-v3 | 78.53 |
| Qwen2-7B | medium | Winogrande | qwen2-7b | Qwen | 65 | Qwen/Qwen2-7B | 78.4 |
| una-cybertron-7B-v2-GGUF | low | Winogrande (5-s) | una-cybertron-7b-v2-bf16 | TheBloke | 66 | fblgit/una-cybertron-7b-v2-bf16 | 78.37 |
| neural-chat-7B-v3-1-GGUF | low | Winogrande (5-s) | neural-chat-7b-v3-1 | TheBloke | 67 | Intel/neural-chat-7b-v3-1 | 78.37 |
| speechless-mistral-dolphin-orca-platypus-samantha-7B-GGUF | medium | Winogrande | speechless-mistral-dolphin-orca-platypus-samantha-7b | TheBloke | 68 | uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7b | 78.37 |
| speechless-mistral-moloras-7B-GGUF | medium | Winogrande | speechless-mistral-moloras-7b | TheBloke | 69 | uukuguy/speechless-mistral-moloras-7b | 78.37 |
| falcon-11B | medium | Winogrande-5shots | falcon-11b | tiiuae | 70 | tiiuae/falcon-11B | 78.3 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16 | medium | WinoGrande (5-shot, acc) | nvidia-nemotron-3-nano-30b-a3b-base-bf16 | nvidia | 71 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16 | 78.22 |
| Nous-Hermes-2-SOLAR-10.7B-GGUF | medium | winogrande | nous-hermes-2-solar-10-7b | TheBloke | 72 | NousResearch/Nous-Hermes-2-SOLAR-10.7B | 78.14 |
| speechless-mistral-7B-dare-0.85-GGUF | low | Winogrande | speechless-mistral-7b-dare-0-85 | TheBloke | 73 | speechlessai/speechless-mistral-7b-dare-0.85 | 78.14 |
| NeuralHermes-2.5-Mistral-7B-laser | medium | Winogrande (5-shot) | openhermes-2-5-mistral-7b | mlabonne | 74 | teknium/OpenHermes-2.5-Mistral-7B | 78.14 |
| SynthIA-7B-v1.3-dare-0.85-GGUF | low | Winogrande | Unknown | TheBloke | 75 | uukuguy/SynthIA-7B-v1.3-dare-0.85 | 78.14 |
| airoboros-m-7B-3.1.2-dare-0.85-GGUF | low | Winogrande | Unknown | TheBloke | 76 | uukuguy/airoboros-m-7b-3.1.2-dare-0.85 | 78.14 |
| CollectiveCognition-v1.1-Mistral-7B-dare-0.85-GGUF | low | Winogrande | Unknown | TheBloke | 77 | uukuguy/CollectiveCognition-v1.1-Mistral-7B-dare-0.85 | 78.14 |
| notus-7B-v1-GGUF | low | Winogrande | notus-7b-v1 | TheBloke | 78 | argilla/notus-7b-v1 | 77.74 |
| notus-7B-v1-AWQ | low | Winogrande | notus-7b-v1 | TheBloke | 79 | argilla/notus-7b-v1 | 77.74 |
| Nous-Hermes-Llama2-70B-GGUF | medium | winogrande | Unknown | TheBloke | 80 | NousResearch/Nous-Hermes-Llama2-70b | 77.51 |
| Mistral-Nemo-Instruct-2407 | medium | Winogrande (0-shot) | mistral-nemo-base-2407 | mistralai | 81 | mistralai/Mistral-Nemo-Base-2407 | 76.8 |
| Mistral-Nemo-Base-2407 | medium | Winogrande (0-shot) | mistral-nemo-base-2407 | mistralai | 82 | mistralai/Mistral-Nemo-Base-2407 | 76.8 |
| juanako-7B-UNA-GGUF | medium | winogrande | juanako-7b-una | TheBloke | 83 | fblgit/juanako-7b-UNA | 76.8 |
| Mistral-Nemo-Instruct-FP8-2407 | medium | Winogrande (0-shot) | mistral-nemo-base-2407 | mistralai | 84 | mistralai/Mistral-Nemo-Base-2407 | 76.8 |
| Synatra-7B-v0.3-RP-GGUF | medium | Winogrande (5-shot) | Unknown | TheBloke | 85 | maywell/Synatra-7B-v0.3-RP | 76.48 |
| koOpenChat-sft-GGUF | medium | Winogrande (5-shot) | Unknown | TheBloke | 86 | maywell/koOpenChat-sft | 76.4 |
| Synatra-7B-v0.3-dpo-GGUF | medium | Winogrande (5-shot) | Unknown | TheBloke | 87 | maywell/Synatra-7B-v0.3-dpo | 76.24 |
| Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF | medium | winogrande | nous-hermes-2-mixtral-8x7b-dpo | TheBloke | 88 | NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO | 76.16 |
| Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ | medium | winogrande | nous-hermes-2-mixtral-8x7b-dpo | TheBloke | 89 | NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO | 76.16 |
| Nemotron-Labs-TwoTower-30B-A3B-Base-BF16 | medium | WinoGrande (5-shot, acc) | nemotron-labs-twotower-30b-a3b-base-bf16 | nvidia | 90 | nvidia/Nemotron-Labs-TwoTower-30B-A3B-Base-BF16 | 76.09 |
| juanako-7B-v1-GGUF | medium | winogrande | juanako-7b-v1 | TheBloke | 91 | fblgit/juanako-7b-v1 | 76.09 |
| laser-dolphin-mixtral-2x7b-dpo-GGUF | medium | winogrande | laser-dolphin-mixtral-2x7b-dpo | TheBloke | 92 | macadeliccc/laser-dolphin-mixtral-2x7b-dpo | 75.77 |
| Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF | medium | winogrande | nous-hermes-2-mixtral-8x7b-sft | TheBloke | 93 | NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT | 75.69 |
| NeuralHermes-2.5-Mistral-7B-laser | medium | winogrande | openhermes-2-5-mistral-7b | mlabonne | 94 | teknium/OpenHermes-2.5-Mistral-7B | 75.22 |
| DPOpenHermes-7B-GGUF | medium | winogrande | dpopenhermes-7b | TheBloke | 95 | openaccess-ai-collective/DPOpenHermes-7B | 74.82 |
| OpenHermes-2-Mistral-7B-GGUF | medium | winogrande | mistral-7b-v0-1 | TheBloke | 96 | teknium/OpenHermes-2-Mistral-7B | 74.66 |
| OpenHermes-2-Mistral-7B-AWQ | medium | winogrande | mistral-7b-v0-1 | TheBloke | 97 | teknium/OpenHermes-2-Mistral-7B | 74.66 |
| digital-socrates-13b | medium | Winogrande (5-shot) | Unknown | allenai | 98 | allenai/digital-socrates-13b | 74.59 |
| CollectiveCognition-v1-Mistral-7B-GGUF | medium | winogrande | mistral-7b-v0-1 | TheBloke | 99 | teknium/CollectiveCognition-v1-Mistral-7B | 74.51 |
| MLewd-v2.4-13B-GGUF | medium | Winogrande (5-shot) | Unknown | TheBloke | 100 | Undi95/MLewd-v2.4-13B | 74.51 |
| bagel-dpo-7B-v0.1-GGUF | low | winogrande | bagel-dpo-7b-v0-1 | TheBloke | 101 | jondurbin/bagel-dpo-7b-v0.1 | 74.43 |
| Qwen2-0.5B | medium | Winogrande | qwen2-0-5b | Qwen | 102 | Qwen/Qwen2-0.5B | 74.4 |
| Qwen2-1.5B | medium | Winogrande | qwen2-1-5b | Qwen | 103 | Qwen/Qwen2-1.5B | 74.4 |
| OpenHermes-2.5-Mistral-7B-AWQ | medium | winogrande | openhermes-2-5-mistral-7b | TheBloke | 104 | teknium/OpenHermes-2.5-Mistral-7B | 74.35 |
| OpenHermes-2.5-Mistral-7B-GGUF | medium | winogrande | openhermes-2-5-mistral-7b | TheBloke | 105 | teknium/OpenHermes-2.5-Mistral-7B | 74.35 |
| OpenHermes-2.5-Mistral-7B-16k-GGUF | medium | winogrande | Unknown | TheBloke | 106 | NurtureAI/OpenHermes-2.5-Mistral-7B-16k | 74.35 |
| OpenHermes-2.5-Mistral-7B-GPTQ | medium | winogrande | openhermes-2-5-mistral-7b | TheBloke | 107 | teknium/OpenHermes-2.5-Mistral-7B | 74.35 |
| Mistral-11B-OmniMix-GGUF | medium | winogrande | mistral-11b-omnimix-bf16 | TheBloke | 108 | NeverSleep/Mistral-11B-OmniMix-bf16 | 74.27 |
| Ministral-8B-Instruct-2410 | low | Winogrande | ministral-8b-instruct-2410 | mistralai | 109 | mistralai/Ministral-8B-Instruct-2410 | 74.2 |
| llama2-7B-layla-GGUF | medium | Winogrande (5-shot) | Unknown | TheBloke | 110 | l3utterfly/llama2-7b-layla | 74.11 |
| Darewin-7B-v2 | medium | Winogrande (5-shot) | mistral-ft-optimized-1227 | mlabonne | 111 | OpenPipe/mistral-ft-optimized-1227 | 73.95 |
| GML-Mistral-merged-v1 | medium | Winogrande (5-shot) | gml-mistral-merged-v1 | mlabonne | 112 | mlabonne/GML-Mistral-merged-v1 | 73.88 |
| Iambe-RP-v3-20B-GGUF | medium | winogrande | iambe-rp-v3-20b | TheBloke | 113 | athirdpath/Iambe-RP-v3-20b | 73.8 |
| falcon-mamba-7b | low | `Winogrande` | falcon-mamba-7b | tiiuae | 114 | tiiuae/falcon-mamba-7b | 73.64 |
| falcon-mamba-7b-instruct | low | `Winogrande` | falcon-mamba-7b | tiiuae | 115 | tiiuae/falcon-mamba-7b | 73.64 |
| falcon-mamba-7b-instruct-Q4_K_M-GGUF | low | `Winogrande` | falcon-mamba-7b-instruct | tiiuae | 116 | tiiuae/falcon-mamba-7b-instruct | 73.64 |
| falcon-mamba-7b-instruct-4bit | low | `Winogrande` | falcon-mamba-7b-instruct | tiiuae | 117 | tiiuae/falcon-mamba-7b-instruct | 73.64 |
| falcon-mamba-7b-Q8_0-GGUF | low | `Winogrande` | falcon-mamba-7b | tiiuae | 118 | tiiuae/falcon-mamba-7b | 73.64 |
| falcon-mamba-7b-F16-GGUF | low | `Winogrande` | falcon-mamba-7b | tiiuae | 119 | tiiuae/falcon-mamba-7b | 73.64 |
| falcon-mamba-7b-4bit | low | `Winogrande` | falcon-mamba-7b | tiiuae | 120 | tiiuae/falcon-mamba-7b | 73.64 |
| Dr_Samantha-7B-GGUF | low | Winogrande | dr-samantha-7b | TheBloke | 121 | sethuiyer/Dr_Samantha-7b | 73.56 |
| CollectiveCognition-v1.1-Mistral-7B-GGUF | medium | winogrande | mistral-7b-v0-1 | TheBloke | 122 | teknium/CollectiveCognition-v1.1-Mistral-7B | 73.48 |
| digital-socrates-7b | medium | Winogrande (5-shot) | Unknown | allenai | 123 | allenai/digital-socrates-7b | 73.09 |
| minotaur-13B-fixed-GGUF | medium | winogrande | Unknown | TheBloke | 124 | openaccess-ai-collective/minotaur-13b-fixed | 72.85 |
| Synatra-V0.1-7B-Instruct-GGUF | medium | Winogrande (5-shot) | Unknown | TheBloke | 125 | maywell/Synatra-V0.1-7B-Instruct | 72.77 |
| Redmond-Puffin-13B-GGUF | medium | winogrande | Unknown | TheBloke | 126 | NousResearch/Redmond-Puffin-13B | 72.45 |
| Redmond-Puffin-13B-GPTQ | medium | winogrande | Unknown | TheBloke | 127 | NousResearch/Redmond-Puffin-13B | 72.45 |
| TenyxChat-7B-v1-GGUF | high | Winogrande | tenyxchat-7b-v1 | TheBloke | 128 | tenyx/TenyxChat-7B-v1 | 72.3 |
| Nous-Hermes-13B-GGUF | medium | winogrande | Unknown | TheBloke | 129 | NousResearch/Nous-Hermes-13b | 71.9 |
| Nous-Hermes-13B-SuperHOT-8K-fp16 | medium | winogrande | Unknown | TheBloke | 130 | — | 71.9 |
| Nous-Hermes-13B-SuperHOT-8K-GPTQ | medium | winogrande | Unknown | TheBloke | 131 | — | 71.9 |
| Tulpar-7B-v0-GGUF | medium | winogrande | Unknown | TheBloke | 132 | HyperbeeAI/Tulpar-7b-v0 | 71.59 |
| Nemotron-H-4B-Base-8K | low | Winogrande 0-shot | nemotron-h-4b-base-8k | nvidia | 133 | nvidia/Nemotron-H-4B-Base-8K | 71.3 |
| gemma-2-2b-it | medium | [WinoGrande][] | gemma-2-2b | 134 | google/gemma-2-2b | 70.9 | |
| gemma-2-2b | medium | [WinoGrande][] | gemma-2-2b | 135 | google/gemma-2-2b | 70.9 | |
| OLMoE-1B-7B-0125 | low | Open Data | olmoe-1b-7b-0125 | allenai | 136 | allenai/OLMoE-1B-7B-0125 | 70.6 |
| Apertus-8B-Instruct-2509-GGUF | low | **WinoGrande** | apertus-8b-instruct-2509 | unsloth | 137 | swiss-ai/Apertus-8B-Instruct-2509 | 70.6 |
| Apertus-70B-Instruct-2509-GGUF | low | **WinoGrande** | apertus-70b-instruct-2509 | unsloth | 138 | swiss-ai/Apertus-70B-Instruct-2509 | 70.6 |
| Apertus-8B-Instruct-2509-unsloth-bnb-4bit | low | **WinoGrande** | apertus-8b-2509 | unsloth | 139 | swiss-ai/Apertus-8B-2509 | 70.6 |
| OLMo-1B-0724-hf | medium | winogrande | olmo-1b-0724-hf | allenai | 140 | allenai/OLMo-1B-0724-hf | 70.5 |
| OLMo-7B-0424-hf | medium | winogrande | olmo-7b-0424-hf | allenai | 141 | allenai/OLMo-7B-0424-hf | 70.5 |
| OLMo-7B-0724-hf | medium | winogrande | olmo-7b-0724-hf | allenai | 142 | allenai/OLMo-7B-0724-hf | 70.5 |
| OLMo-7B-0424 | medium | winogrande | Unknown | allenai | 143 | allenai/OLMo-7B-0424 | 70.5 |
| OLMoE-1B-7B-0924 | low | Open Data | olmoe-1b-7b-0924 | allenai | 144 | allenai/OLMoE-1B-7B-0924 | 70.2 |
| OLMo-1B-hf | medium | winogrande | olmo-1b-hf | allenai | 145 | allenai/OLMo-1B-hf | 68.2 |
| OLMo-7B | medium | winogrande | olmo-7b | allenai | 146 | allenai/OLMo-7B | 68.2 |
| OLMo-7B-hf | medium | winogrande | olmo-7b-hf | allenai | 147 | allenai/OLMo-7B-hf | 68.2 |
| OLMo-1B | medium | winogrande | olmo-1b | allenai | 148 | allenai/OLMo-1B | 68.2 |
| OLMo-7B-Twin-2T-hf | medium | winogrande | olmo-7b-twin-2t-hf | allenai | 149 | allenai/OLMo-7B-Twin-2T-hf | 68.2 |
| OLMo-7B-Twin-2T | medium | winogrande | olmo-7b-twin-2t | allenai | 150 | allenai/OLMo-7B-Twin-2T | 68.2 |
| Falcon-H1-3B-Base | medium | Winogrande | falcon-h1-3b-base | tiiuae | 151 | tiiuae/Falcon-H1-3B-Base | 68.11 |
| rocket-3B-GGUF | medium | Winogrande (5-shot) | rocket-3b | TheBloke | 152 | pansophic/rocket-3B | 67.8 |
| Falcon-H1-1.5B-Deep-Base | medium | Winogrande | falcon-h1-1-5b-deep-base | tiiuae | 153 | tiiuae/Falcon-H1-1.5B-Deep-Base | 67.09 |
| Phi-4-mini-instruct | medium | Winogrande (5-shot) | phi-4-mini-instruct | microsoft | 154 | microsoft/Phi-4-mini-instruct | 67 |
| Phi-4-mini-instruct-GGUF | medium | Winogrande (5-shot) | phi-4-mini-instruct | unsloth | 155 | microsoft/Phi-4-mini-instruct | 67 |
| Phi-4-mini-instruct-unsloth-bnb-4bit | medium | Winogrande (5-shot) | phi-4-mini-instruct | unsloth | 156 | microsoft/Phi-4-mini-instruct | 67 |
| Phi-4-mini-instruct-bnb-4bit | medium | Winogrande (5-shot) | phi-4-mini-instruct | unsloth | 157 | microsoft/Phi-4-mini-instruct | 67 |
| Phi-4-mini-instruct | medium | Winogrande (5-shot) | phi-4-mini-instruct | unsloth | 158 | microsoft/Phi-4-mini-instruct | 67 |
| Phi-4-mini-instruct-GGUF | medium | Winogrande (5-shot) | phi-4-mini-instruct | Mungert | 159 | microsoft/Phi-4-mini-instruct | 67 |
| gemma-3n-E2B-it | medium | [WinoGrande][] | gemma-3n-e4b | 160 | google/gemma-3n-E4B-it | 66.8 | |
| gemma-3n-E4B-it | medium | [WinoGrande][] | gemma-3n-e4b | 161 | google/gemma-3n-E4B | 66.8 | |
| gemma-3n-E4B-it-litert-lm | medium | [WinoGrande][] | gemma-3n-e4b | 162 | google/gemma-3n-E4B-it-litert-lm | 66.8 | |
| gemma-3n-E2B-it-GGUF | medium | [WinoGrande][] | gemma-3n-e2b-it | unsloth | 163 | google/gemma-3n-E2B-it | 66.8 |
| gemma-3n-E4B-it | medium | [WinoGrande][] | gemma-3n-e4b | unsloth | 164 | google/gemma-3n-E4B-it | 66.8 |
| gemma-3n-E2B | medium | [WinoGrande][] | gemma-3n-e4b | 165 | google/gemma-3n-E4B | 66.8 | |
| gemma-3n-E2B-it-litert-lm | medium | [WinoGrande][] | gemma-3n-e2b-it | 166 | google/gemma-3n-E2B-it-litert-lm | 66.8 | |
| gemma-3n-E4B-it-GGUF | medium | [WinoGrande][] | gemma-3n-e4b | unsloth | 167 | google/gemma-3n-E4B-it | 66.8 |
| gemma-3n-E4B | medium | [WinoGrande][] | gemma-3n-e4b | 168 | google/gemma-3n-E4B | 66.8 | |
| gemma-3n-E2B-it-unsloth-bnb-4bit | medium | [WinoGrande][] | gemma-3n-e2b-it | unsloth | 169 | google/gemma-3n-E2B-it | 66.8 |
| gemma-3n-E2B-it-litert-preview-GGUF | medium | [WinoGrande][] | gemma-3n-e2b-it | unsloth | 170 | google/gemma-3n-E2B-it-litert-preview | 66.8 |
| gemma-3n-E4B-it-litert-preview-GGUF | medium | [WinoGrande][] | gemma-3n-e4b | unsloth | 171 | google/gemma-3n-E4B-it-litert-preview | 66.8 |
| gemma-3n-E4B-unsloth-bnb-4bit | medium | [WinoGrande][] | gemma-3n-e4b | unsloth | 172 | google/gemma-3n-E4B-it | 66.8 |
| gemma-3n-E2B-it-ONNX | medium | [WinoGrande][] | gemma-3n-e2b-it | onnx-community | 173 | google/gemma-3n-E2B-it | 66.8 |
| gemma-3n-E4B-it-GGUF | medium | [WinoGrande][] | gemma-3n-e4b | Mungert | 174 | google/gemma-3n-E4B | 66.8 |
| gemma-3n-E4B-it-absolute-heresy-MPOA-imatrix-GGUF | medium | [WinoGrande][] | gemma-3n-e4b-it-absolute-heresy-mpoa | MuXodious | 175 | MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA | 66.8 |
| gemma-3n-E4B-it-absolute-heresy-GGUF | medium | [WinoGrande][] | gemma-3n-e4b | MuXodious | 176 | google/gemma-3n-E4B-it | 66.8 |
| gemma-3n-E4B-it-absolute-heresy-MPOA-GGUF | medium | [WinoGrande][] | gemma-3n-e4b-it-absolute-heresy-mpoa | MuXodious | 177 | MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA | 66.8 |
| gemma-3n-E2B-it-GGUF | medium | [WinoGrande][] | gemma-3n-e4b | Mungert | 178 | google/gemma-3n-E4b-it | 66.8 |
| open-llama-3b-v2-wizard-evol-instuct-v2-196k-GGUF | medium | Winogrande (5-shot) | open-llama-3b-v2-wizard-evol-instuct-v2-196k | TheBloke | 179 | harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196k | 66.69 |
| Llama2-7b-WhoIsHarryPotter | low | Winogrande | Unknown | microsoft | 180 | microsoft/Llama2-7b-WhoIsHarryPotter | 66.3 |
| Falcon-H1-1.5B-Base | medium | Winogrande | falcon-h1-1-5b-base | tiiuae | 181 | tiiuae/Falcon-H1-1.5B-Base | 65.59 |
| Gemmalpaca-2B | medium | Winogrande (5-shot) | gemma-2b | mlabonne | 182 | google/gemma-2b | 65.59 |
| stablelm-zephyr-3b-GGUF | medium | Winogrande (5-shot) | stablelm-zephyr-3b | TheBloke | 183 | stabilityai/stablelm-zephyr-3b | 65.5 |
| gemma-1.1-2b-it | medium | [WinoGrande](https://arxiv.org/abs/1907.10641) | gemma-1-1-2b-it | 184 | google/gemma-1.1-2b-it | 65.4 | |
| gemma-2b | medium | [WinoGrande](https://arxiv.org/abs/1907.10641) | gemma-2b-it | 185 | google/gemma-2b-it-pytorch | 65.4 | |
| gemma-2b-it | medium | [WinoGrande](https://arxiv.org/abs/1907.10641) | gemma-2b-it | 186 | google/gemma-2b-it-pytorch | 65.4 | |
| gemma-7b | medium | [WinoGrande](https://arxiv.org/abs/1907.10641) | gemma-7b-it | 187 | google/gemma-7b-it-quant-pytorch | 65.4 | |
| gemma-7b-it | medium | [WinoGrande](https://arxiv.org/abs/1907.10641) | gemma-7b | 188 | google/gemma-7b | 65.4 | |
| gemma-1.1-7b-it | medium | [WinoGrande](https://arxiv.org/abs/1907.10641) | gemma-1-1-7b-it | 189 | google/gemma-1.1-7b-it | 65.4 | |
| gemma-2b-AWQ | medium | [WinoGrande](https://arxiv.org/abs/1907.10641) | gemma-2b-it | 190 | google/gemma-2b-it-pytorch | 65.4 | |
| gemma-7b | medium | [WinoGrande](https://arxiv.org/abs/1907.10641) | gemma-7b-it | alpindale | 191 | google/gemma-7b-it-quant-pytorch | 65.4 |
| gemma-2b | medium | [WinoGrande](https://arxiv.org/abs/1907.10641) | gemma-2b-it | alpindale | 192 | google/gemma-2b-it-pytorch | 65.4 |
| gemma-7b-AWQ | medium | [WinoGrande](https://arxiv.org/abs/1907.10641) | gemma-7b-it | 193 | google/gemma-7b-it-quant-pytorch | 65.4 | |
| gemma-7b-it | medium | [WinoGrande](https://arxiv.org/abs/1907.10641) | gemma-7b-it | alpindale | 194 | google/gemma-7b-it-quant-pytorch | 65.4 |
| gemma-7b-GGUF | medium | [WinoGrande](https://arxiv.org/abs/1907.10641) | gemma-7b-it | 195 | google/gemma-7b-it-quant-pytorch | 65.4 | |
| MobileLLM-Pro-base | medium | WinoGrande | mobilellm-pro-base | 196 | facebook/MobileLLM-Pro-base | 62.83 | |
| MobileLLM-Pro | medium | WinoGrande | mobilellm-pro-base | 197 | facebook/MobileLLM-Pro-base | 62.83 | |
| nemo-megatron-gpt-5B | low | Winogrande | Unknown | nvidia | 198 | nvidia/nemo-megatron-gpt-5B | 61.33 |
| bitnet-b1.58-2B-4T-gguf | medium | WinoGrande | bitnet-b1-58-2b-4t-bf16 | microsoft | 199 | microsoft/bitnet-b1.58-2B-4T-bf16 | 59.51 |
| bitnet-b1.58-2B-4T | medium | WinoGrande | bitnet-b1-58-2b-4t | microsoft | 200 | microsoft/bitnet-b1.58-2B-4T | 59.51 |
| bitnet-b1.58-2B-4T-bf16 | medium | WinoGrande | bitnet-b1-58-2b-4t-bf16 | microsoft | 201 | microsoft/bitnet-b1.58-2B-4T-bf16 | 59.51 |
| Falcon-H1-0.5B-Base | medium | Winogrande | falcon-h1-0-5b-base | tiiuae | 202 | tiiuae/Falcon-H1-0.5B-Base | 59.43 |
| SmolLM2-1.7B-Instruct-GGUF | medium | Winogrande | smollm2-1-7b | Mungert | 203 | HuggingFaceTB/SmolLM2-1.7B | 59.4 |
| TinyLlama-1.1B-intermediate-step-1431k-3T-GGUF | high | WinoGrande | tinyllama-1-1b-intermediate-step-1431k-3t | TheBloke | 204 | TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T | 59.12 |
| TinyLlama-1.1B-intermediate-step-715k-1.5T-GGUF | high | WinoGrande | tinyllama-1-1b-intermediate-step-715k-1-5t | TheBloke | 205 | PY007/TinyLlama-1.1B-intermediate-step-715k-1.5T | 58.33 |
| gemma-3-1b-it | medium | [WinoGrande][] | gemma-3-1b-it | 206 | google/gemma-3-1b-pt | 58.2 | |
| gemma-3-4b-it | medium | [WinoGrande][] | gemma-3-4b-it | 207 | google/gemma-3-4b-pt | 58.2 | |
| gemma-3-12b-it | medium | [WinoGrande][] | gemma-3-12b-pt | 208 | google/gemma-3-12b-pt | 58.2 | |
| gemma-3-27b-it | medium | [WinoGrande][] | gemma-3-27b-pt | 209 | google/gemma-3-27b-pt | 58.2 | |
| gemma-3-4b-it | medium | [WinoGrande][] | gemma-3-4b-it | unsloth | 210 | google/gemma-3-4b-it | 58.2 |
| gemma-3-1b-it-GGUF | medium | [WinoGrande][] | gemma-3-1b-it | ggml-org | 211 | google/gemma-3-1b-it | 58.2 |
| gemma-3-12b-it-qat-q4_0-unquantized | medium | [WinoGrande][] | gemma-3-12b-it | 212 | google/gemma-3-12b-it | 58.2 | |
| gemma-3-1b-it | medium | [WinoGrande][] | gemma-3-1b-it | unsloth | 213 | google/gemma-3-1b-it | 58.2 |
| gemma-3-12b-it-GGUF | medium | [WinoGrande][] | gemma-3-12b-it | unsloth | 214 | google/gemma-3-12b-it | 58.2 |
| gemma-3-4b-pt | medium | [WinoGrande][] | gemma-3-4b-pt | 215 | google/gemma-3-4b-pt | 58.2 | |
| gemma-3-12b-it-qat-GGUF | medium | [WinoGrande][] | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 216 | google/gemma-3-12b-it-qat-q4_0-unquantized | 58.2 |
| gemma-3-27b-it | medium | [WinoGrande][] | gemma-3-27b-it | unsloth | 217 | google/gemma-3-27b-it | 58.2 |
| gemma-3-1b-pt | medium | [WinoGrande][] | gemma-3-1b-pt | 218 | google/gemma-3-1b-pt | 58.2 | |
| gemma-3-4b-it-GGUF | medium | [WinoGrande][] | gemma-3-4b-it | ggml-org | 219 | google/gemma-3-4b-it | 58.2 |
| gemma-3-4b-it-GGUF | medium | [WinoGrande][] | gemma-3-4b-it | unsloth | 220 | google/gemma-3-4b-it | 58.2 |
| gemma-3-1b-it-GGUF | medium | [WinoGrande][] | gemma-3-1b-it | unsloth | 221 | google/gemma-3-1b-it | 58.2 |
| gemma-3-12b-pt | medium | [WinoGrande][] | gemma-3-12b-pt | 222 | google/gemma-3-12b | 58.2 | |
| gemma-3-12b-it-unsloth-bnb-4bit | medium | [WinoGrande][] | gemma-3-12b-it | unsloth | 223 | google/gemma-3-12b-it | 58.2 |
| gemma-3-4b-it-unsloth-bnb-4bit | medium | [WinoGrande][] | gemma-3-4b-it | unsloth | 224 | google/gemma-3-4b-it | 58.2 |
| gemma-3-12b-it | medium | [WinoGrande][] | gemma-3-12b-pt | unsloth | 225 | google/gemma-3-12b-pt | 58.2 |
| gemma-3-27b-it-GGUF | medium | [WinoGrande][] | gemma-3-27b-it | unsloth | 226 | google/gemma-3-27b-it | 58.2 |
| gemma-3-1b-it-unsloth-bnb-4bit | medium | [WinoGrande][] | gemma-3-1b-it | unsloth | 227 | google/gemma-3-1b-it | 58.2 |
| gemma-3-4b-it-bnb-4bit | medium | [WinoGrande][] | gemma-3-4b-it | unsloth | 228 | google/gemma-3-4b-it | 58.2 |
| gemma-3-4b-pt | medium | [WinoGrande][] | gemma-3-4b-pt | unsloth | 229 | google/gemma-3-4b-pt | 58.2 |
| gemma-3-27b-pt | medium | [WinoGrande][] | gemma-3-27b-pt | 230 | google/gemma-3-27b-pt | 58.2 | |
| gemma-3-12b-it-bnb-4bit | medium | [WinoGrande][] | gemma-3-12b-it | unsloth | 231 | google/gemma-3-12b-it | 58.2 |
| gemma-3-27b-it-GGUF | medium | [WinoGrande][] | gemma-3-27b-it | ggml-org | 232 | google/gemma-3-27b-it | 58.2 |
| gemma-3-12b-pt | medium | [WinoGrande][] | gemma-3-12b-pt | unsloth | 233 | google/gemma-3-12b-pt | 58.2 |
| gemma-3-27b-it-bnb-4bit | medium | [WinoGrande][] | gemma-3-27b-it | unsloth | 234 | google/gemma-3-27b-it | 58.2 |
| gemma-3-27b-it-unsloth-bnb-4bit | medium | [WinoGrande][] | gemma-3-27b-it | unsloth | 235 | google/gemma-3-27b-it | 58.2 |
| gemma-3-1b-pt | medium | [WinoGrande][] | gemma-3-1b-pt | unsloth | 236 | google/gemma-3-1b-pt | 58.2 |
| gemma-3-12b-it-GGUF | medium | [WinoGrande][] | gemma-3-12b-it | ggml-org | 237 | google/gemma-3-12b-it | 58.2 |
| gemma-3-4b-it-qat-GGUF | medium | [WinoGrande][] | gemma-3-4b-it-qat-q4-0-unquantized | unsloth | 238 | google/gemma-3-4b-it-qat-q4_0-unquantized | 58.2 |
| gemma-3-12b-it-qat-bnb-4bit | medium | [WinoGrande][] | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 239 | google/gemma-3-12b-it-qat-q4_0-unquantized | 58.2 |
| gemma-3-12b-it-qat-int4-GGUF | medium | [WinoGrande][] | gemma-3-12b-it-qat-int4-unquantized | unsloth | 240 | google/gemma-3-12b-it-qat-int4-unquantized | 58.2 |
| gemma-3-4b-it-qat-q4_0-gguf | medium | [WinoGrande][] | gemma-3-4b-it | 241 | google/gemma-3-4b-it | 58.2 | |
| gemma-3-4b-it-qat-q4_0-unquantized | medium | [WinoGrande][] | gemma-3-4b-it | 242 | google/gemma-3-4b-it | 58.2 | |
| gemma-3-4b-pt-bnb-4bit | medium | [WinoGrande][] | gemma-3-4b-pt | unsloth | 243 | google/gemma-3-4b-pt | 58.2 |
| gemma-3-27b-it-qat-GGUF | medium | [WinoGrande][] | gemma-3-27b-it-qat-q4-0-unquantized | unsloth | 244 | google/gemma-3-27b-it-qat-q4_0-unquantized | 58.2 |
| gemma-3-12b-it-qat-q4_0-gguf | medium | [WinoGrande][] | gemma-3-12b-it | 245 | google/gemma-3-12b-it | 58.2 | |
| gemma-3-1b-it-bnb-4bit | medium | [WinoGrande][] | gemma-3-1b-it | unsloth | 246 | google/gemma-3-1b-it | 58.2 |
| gemma-3-1b-it-qat-q4_0-gguf | medium | [WinoGrande][] | gemma-3-1b-it | 247 | google/gemma-3-1b-it | 58.2 | |
| gemma-3-4b-pt-unsloth-bnb-4bit | medium | [WinoGrande][] | gemma-3-4b-pt | unsloth | 248 | google/gemma-3-4b-pt | 58.2 |
| gemma-3-12b-it-qat | medium | [WinoGrande][] | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 249 | google/gemma-3-12b-it-qat-q4_0-unquantized | 58.2 |
| gemma-3-1b-pt-unsloth-bnb-4bit | medium | [WinoGrande][] | gemma-3-1b-pt | unsloth | 250 | google/gemma-3-1b-pt | 58.2 |
| gemma-3-4b-it-FP8-Dynamic | medium | [WinoGrande][] | gemma-3-4b-it | unsloth | 251 | google/gemma-3-4b-it | 58.2 |
| gemma-3-12b-pt-bnb-4bit | medium | [WinoGrande][] | gemma-3-12b-pt | unsloth | 252 | google/gemma-3-12b-pt | 58.2 |
| gemma-3-12b-it-qat-int4-unquantized | medium | [WinoGrande][] | gemma-3-12b-it | 253 | google/gemma-3-12b-it | 58.2 | |
| gemma-3-27b-it-GGUF | medium | [WinoGrande][] | gemma-3-27b-pt | Mungert | 254 | google/gemma-3-27b-pt | 58.2 |
| gemma-3-27b-it-qat-q4_0-unquantized | medium | [WinoGrande][] | gemma-3-27b-it | 255 | google/gemma-3-27b-it | 58.2 | |
| gemma-3-12b-pt-unsloth-bnb-4bit | medium | [WinoGrande][] | gemma-3-12b-pt | unsloth | 256 | google/gemma-3-12b-pt | 58.2 |
| gemma-3-27b-it-qat-q4_0-gguf | medium | [WinoGrande][] | gemma-3-27b-it | 257 | google/gemma-3-27b-it | 58.2 | |
| gemma-3-27b-it-qat-q4_0-GGUF | medium | [WinoGrande][] | gemma-3-27b-it | Mungert | 258 | google/gemma-3-27b-it | 58.2 |
| gemma-3-4b-it-qat-bnb-4bit | medium | [WinoGrande][] | gemma-3-4b-it-qat-q4-0-unquantized | unsloth | 259 | google/gemma-3-4b-it-qat-q4_0-unquantized | 58.2 |
| gemma-3-1b-pt-bnb-4bit | medium | [WinoGrande][] | gemma-3-1b-pt | unsloth | 260 | google/gemma-3-1b-pt | 58.2 |
| gemma-3-27b-pt | medium | [WinoGrande][] | gemma-3-27b-pt | unsloth | 261 | google/gemma-3-27b-pt | 58.2 |
| gemma-3-12b-it-FP8-Dynamic | medium | [WinoGrande][] | gemma-3-12b-pt | unsloth | 262 | google/gemma-3-12b-pt | 58.2 |
| gemma-3-1b-it-qat-int4-unquantized | medium | [WinoGrande][] | gemma-3-1b-it | 263 | google/gemma-3-1b-it | 58.2 | |
| gemma-3-27b-pt-bnb-4bit | medium | [WinoGrande][] | gemma-3-27b-pt | unsloth | 264 | google/gemma-3-27b-pt | 58.2 |
| gemma-3-12b-it-qat-unsloth-bnb-4bit | medium | [WinoGrande][] | gemma-3-12b-it-qat-q4-0-unquantized | unsloth | 265 | google/gemma-3-12b-it-qat-q4_0-unquantized | 58.2 |
| gemma-3-12b-pt-qat-q4_0-gguf | medium | [WinoGrande][] | gemma-3-12b-pt | 266 | google/gemma-3-12b-pt | 58.2 | |
| gemma-3-4b-it-qat | medium | [WinoGrande][] | gemma-3-4b-it-qat-q4-0-unquantized | unsloth | 267 | google/gemma-3-4b-it-qat-q4_0-unquantized | 58.2 |
| gemma-3-1b-it-qat-q4_0-unquantized | medium | [WinoGrande][] | gemma-3-1b-it | 268 | google/gemma-3-1b-it | 58.2 | |
| gemma-3-1b-it-qat | medium | [WinoGrande][] | gemma-3-1b-it-qat-q4-0-unquantized | unsloth | 269 | google/gemma-3-1b-it-qat-q4_0-unquantized | 58.2 |
| gemma-3-27b-it-qat | medium | [WinoGrande][] | gemma-3-27b-it-qat-q4-0-unquantized | unsloth | 270 | google/gemma-3-27b-it-qat-q4_0-unquantized | 58.2 |
| gemma-3-4b-pt-qat-q4_0-gguf | medium | [WinoGrande][] | gemma-3-4b-pt | 271 | google/gemma-3-4b-pt | 58.2 | |
| t5gemma-2-270m-270m | medium | [WinoGrande] | t5gemma-2-270m-270m | 272 | google/t5gemma-2-270m-270m | 53.9 | |
| t5gemma-2-4b-4b | medium | [WinoGrande] | t5gemma-2-4b-4b | 273 | google/t5gemma-2-4b-4b | 53.9 | |
| t5gemma-2-1b-1b | medium | [WinoGrande] | t5gemma-2-1b-1b | 274 | google/t5gemma-2-1b-1b | 53.9 | |
| Redmond-Hermes-Coder-GPTQ | medium | winogrande | Unknown | TheBloke | 275 | — | 53.43 |
| SmolLM2-360M-Instruct-GGUF | medium | Winogrande | smollm2-360m | Mungert | 276 | HuggingFaceTB/SmolLM2-360M | 52.5 |
| gemma-3-270m | medium | [WinoGrande][] | gemma-3-270m | 277 | google/gemma-3-270m | 52 | |
| gemma-3-270m-it | medium | [WinoGrande][] | gemma-3-270m | 278 | google/gemma-3-270m | 52 | |
| gemma-3-270m-it-GGUF | medium | [WinoGrande][] | gemma-3-270m-it | unsloth | 279 | google/gemma-3-270m-it | 52 |
| gemma-3-270m-it | medium | [WinoGrande][] | gemma-3-270m-it | unsloth | 280 | google/gemma-3-270m-it | 52 |
| gemma-3-270m-it-unsloth-bnb-4bit | medium | [WinoGrande][] | gemma-3-270m-it | unsloth | 281 | google/gemma-3-270m-it | 52 |
| gemma-3-270m-it-qat-GGUF | medium | [WinoGrande][] | gemma-3-270m-it-qat-q4-0-unquantized | unsloth | 282 | google/gemma-3-270m-it-qat-q4_0-unquantized | 52 |
| gemma-3-270m | medium | [WinoGrande][] | gemma-3-270m | unsloth | 283 | google/gemma-3-270m | 52 |
| gemma-3-270m-unsloth-bnb-4bit | medium | [WinoGrande][] | gemma-3-270m-it | unsloth | 284 | google/gemma-3-270m-it | 52 |
| gemma-3-270m-it-qat-q4_0-unquantized | medium | [WinoGrande][] | gemma-3-270m-it | 285 | google/gemma-3-270m-it | 52 | |
| gemma-3-270m-it-bnb-4bit | medium | [WinoGrande][] | gemma-3-270m-it | unsloth | 286 | google/gemma-3-270m-it | 52 |
| gemma-3-270m-it-qat | medium | [WinoGrande][] | gemma-3-270m-it-qat-q4-0-unquantized | unsloth | 287 | google/gemma-3-270m-it-qat-q4_0-unquantized | 52 |
| gemma-3-270m-bnb-4bit | medium | [WinoGrande][] | gemma-3-270m | unsloth | 288 | google/gemma-3-270m | 52 |
| gemma-3-270m-qat-q4_0-unquantized | medium | [WinoGrande][] | gemma-3-270m | 289 | google/gemma-3-270m | 52 | |
| gemma-3-270m-it-GGUF | medium | [WinoGrande][] | gemma-3-270m | Mungert | 290 | google/gemma-3-270m | 52 |
| gemma-3-270m-it-torchao-FP8 | medium | [WinoGrande][] | gemma-3-270m-it | unsloth | 291 | google/gemma-3-270m-it | 52 |
| SmolLM2-135M-Instruct-GGUF | medium | Winogrande | smollm2-135m | Mungert | 292 | HuggingFaceTB/SmolLM2-135M | 51.3 |
| MobileLLM-125M | low | winogrande | Unknown | 293 | facebook/MobileLLM-125M | 50.8 | |
| DialoGPT-small | medium | Winogrande (5-shot) | Unknown | microsoft | 294 | microsoft/DialoGPT-small | 50.28 |
Provenance & metadata (1)
source
- kind
- leaderboard-scrape
- paths
- benchmarks/winogrande.html, docs/notes/hf-benchmark-contexts.json