Leaderboard
Humanity's Last Exam
hleRecord
- Category
- knowledge
- Scored models
- 330
Scores
| Model | Score |
|---|---|
| zai-org/GLM-5.2 | 54.7 |
| zai-org/GLM-5.2 | 54.7 |
| zai-org/GLM-5.2 | 54.7 |
| zai-org/GLM-5.2 | 54.7 |
| zai-org/GLM-5.2 | 54.7 |
| deepseek-ai/DeepSeek-V4-Flash | 53.1 |
| deepseek-ai/DeepSeek-V4-Pro | 53.1 |
| — | 53.1 |
| deepseek-ai/DeepSeek-V4-Flash | 53.1 |
| deepseek-ai/DeepSeek-V4-Flash | 53.1 |
| — | 53.1 |
| deepseek-ai/DeepSeek-V4-Pro | 53.1 |
| zai-org/GLM-5.1 | 52.3 |
| zai-org/GLM-5.1 | 52.3 |
| zai-org/GLM-5.1 | 52.3 |
| zai-org/GLM-5 | 50.4 |
| zai-org/GLM-5 | 50.4 |
| zai-org/GLM-5 | 50.4 |
| zai-org/GLM-5 | 50.4 |
| zai-org/GLM-4.7 | 42.8 |
| zai-org/GLM-4.7 | 42.8 |
| zai-org/GLM-4.7 | 42.8 |
| zai-org/GLM-5.2 | 40.5 |
| zai-org/GLM-5.2 | 40.5 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- knowledge
- id
- hle
- name
- Humanity's Last Exam
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| GLM-5.2-FP8 | medium | HLE (w/ Tools) | glm-5-2 | zai-org | 1 | zai-org/GLM-5.2 | 54.7 |
| GLM-5.2 | medium | HLE (w/ Tools) | glm-5-2 | zai-org | 2 | zai-org/GLM-5.2 | 54.7 |
| GLM-5.2-GGUF | medium | HLE (w/ Tools) | glm-5-2 | unsloth | 3 | zai-org/GLM-5.2 | 54.7 |
| GLM-5.2-FP8 | medium | HLE (w/ Tools) | glm-5-2 | unsloth | 4 | zai-org/GLM-5.2 | 54.7 |
| GLM-5.2 | medium | HLE (w/ Tools) | glm-5-2 | unsloth | 5 | zai-org/GLM-5.2 | 54.7 |
| DeepSeek-V4-Flash | medium | HLE w/ tools (Pass@1) | deepseek-v4-flash | deepseek-ai | 6 | deepseek-ai/DeepSeek-V4-Flash | 53.1 |
| DeepSeek-V4-Pro | medium | HLE w/ tools (Pass@1) | deepseek-v4-pro | deepseek-ai | 7 | deepseek-ai/DeepSeek-V4-Pro | 53.1 |
| DeepSeek-V4-Flash-DSpark | medium | HLE w/ tools (Pass@1) | Unknown | deepseek-ai | 8 | — | 53.1 |
| DeepSeek-V4-Flash-GGUF | medium | HLE w/ tools (Pass@1) | deepseek-v4-flash | unsloth | 9 | deepseek-ai/DeepSeek-V4-Flash | 53.1 |
| DeepSeek-V4-Flash | medium | HLE w/ tools (Pass@1) | deepseek-v4-flash | unsloth | 10 | deepseek-ai/DeepSeek-V4-Flash | 53.1 |
| DeepSeek-V4-Pro-DSpark | medium | HLE w/ tools (Pass@1) | Unknown | deepseek-ai | 11 | — | 53.1 |
| DeepSeek-V4-Pro | medium | HLE w/ tools (Pass@1) | deepseek-v4-pro | unsloth | 12 | deepseek-ai/DeepSeek-V4-Pro | 53.1 |
| GLM-5.1-FP8 | medium | HLE (w/ Tools) | glm-5-1 | zai-org | 13 | zai-org/GLM-5.1 | 52.3 |
| GLM-5.1 | medium | HLE (w/ Tools) | glm-5-1 | zai-org | 14 | zai-org/GLM-5.1 | 52.3 |
| GLM-5.1-GGUF | medium | HLE (w/ Tools) | glm-5-1 | unsloth | 15 | zai-org/GLM-5.1 | 52.3 |
| GLM-5-FP8 | medium | HLE (w/ Tools) | glm-5 | zai-org | 16 | zai-org/GLM-5 | 50.4 |
| GLM-5 | medium | HLE (w/ Tools) | glm-5 | zai-org | 17 | zai-org/GLM-5 | 50.4 |
| GLM-5-FP8 | medium | HLE (w/ Tools) | glm-5 | unsloth | 18 | zai-org/GLM-5 | 50.4 |
| GLM-5-GGUF | medium | HLE (w/ Tools) | glm-5 | unsloth | 19 | zai-org/GLM-5 | 50.4 |
| GLM-4.7 | medium | HLE (w/ Tools) | glm-4-7 | zai-org | 20 | zai-org/GLM-4.7 | 42.8 |
| GLM-4.7-FP8 | medium | HLE (w/ Tools) | glm-4-7 | zai-org | 21 | zai-org/GLM-4.7 | 42.8 |
| GLM-4.7-GGUF | medium | HLE (w/ Tools) | glm-4-7 | unsloth | 22 | zai-org/GLM-4.7 | 42.8 |
| GLM-5.2-FP8 | medium | HLE | glm-5-2 | zai-org | 23 | zai-org/GLM-5.2 | 40.5 |
| GLM-5.2 | medium | HLE | glm-5-2 | zai-org | 24 | zai-org/GLM-5.2 | 40.5 |
| GLM-5.2-GGUF | medium | HLE | glm-5-2 | unsloth | 25 | zai-org/GLM-5.2 | 40.5 |
| GLM-5.2-FP8 | medium | HLE | glm-5-2 | unsloth | 26 | zai-org/GLM-5.2 | 40.5 |
| GLM-5.2 | medium | HLE | glm-5-2 | unsloth | 27 | zai-org/GLM-5.2 | 40.5 |
| DeepSeek-V4-Flash | medium | HLE (Pass@1) | deepseek-v4-flash | deepseek-ai | 28 | deepseek-ai/DeepSeek-V4-Flash | 40 |
| DeepSeek-V4-Pro | medium | HLE (Pass@1) | deepseek-v4-pro | deepseek-ai | 29 | deepseek-ai/DeepSeek-V4-Pro | 40 |
| DeepSeek-V4-Flash-DSpark | medium | HLE (Pass@1) | Unknown | deepseek-ai | 30 | — | 40 |
| DeepSeek-V4-Flash-GGUF | medium | HLE (Pass@1) | deepseek-v4-flash | unsloth | 31 | deepseek-ai/DeepSeek-V4-Flash | 40 |
| DeepSeek-V4-Flash | medium | HLE (Pass@1) | deepseek-v4-flash | unsloth | 32 | deepseek-ai/DeepSeek-V4-Flash | 40 |
| DeepSeek-V4-Pro-DSpark | medium | HLE (Pass@1) | Unknown | deepseek-ai | 33 | — | 40 |
| DeepSeek-V4-Pro | medium | HLE (Pass@1) | deepseek-v4-pro | unsloth | 34 | deepseek-ai/DeepSeek-V4-Pro | 40 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | medium | HLE (with tools) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | nvidia | 35 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 37.4 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-GGUF | medium | HLE (with tools) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | unsloth | 36 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 37.4 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | medium | HLE (with tools) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | unsloth | 37 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 37.4 |
| MiniMax-M2 | medium | **HLE (w/ tools)** | minimax-m2 | MiniMaxAI | 38 | MiniMaxAI/MiniMax-M2 | 31.8 |
| MiniMax-M2-GGUF | medium | **HLE (w/ tools)** | minimax-m2 | unsloth | 39 | MiniMaxAI/MiniMax-M2 | 31.8 |
| GLM-5.1-FP8 | medium | HLE | glm-5-1 | zai-org | 40 | zai-org/GLM-5.1 | 31 |
| GLM-5.1 | medium | HLE | glm-5-1 | zai-org | 41 | zai-org/GLM-5.1 | 31 |
| GLM-5.1-GGUF | medium | HLE | glm-5-1 | unsloth | 42 | zai-org/GLM-5.1 | 31 |
| GLM-5-FP8 | medium | HLE | glm-5 | zai-org | 43 | zai-org/GLM-5 | 30.5 |
| GLM-5 | medium | HLE | glm-5 | zai-org | 44 | zai-org/GLM-5 | 30.5 |
| GLM-5-FP8 | medium | HLE | glm-5 | unsloth | 45 | zai-org/GLM-5 | 30.5 |
| GLM-5-GGUF | medium | HLE | glm-5 | unsloth | 46 | zai-org/GLM-5 | 30.5 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | medium | HLE (no tools) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | nvidia | 47 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 26.7 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | medium | HLE (no tools) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | nvidia | 48 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 26.7 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-GGUF | medium | HLE (no tools) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | unsloth | 49 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 26.7 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | medium | HLE (no tools) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | unsloth | 50 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 26.7 |
| gemma-4-26B-A4B-it | medium | HLE with search | gemma-4-26b-a4b | 51 | google/gemma-4-26B-A4B | 26.5 | |
| gemma-4-31B-it | medium | HLE with search | gemma-4-31b | 52 | google/gemma-4-31B | 26.5 | |
| gemma-4-E4B-it | medium | HLE with search | gemma-4-e4b | 53 | google/gemma-4-E4B | 26.5 | |
| gemma-4-E2B-it | medium | HLE with search | gemma-4-e2b | 54 | google/gemma-4-E2B | 26.5 | |
| gemma-4-12B-it | medium | HLE with search | gemma-4-12b | 55 | google/gemma-4-12B | 26.5 | |
| gemma-4-31B-it-qat-w4a16-ct | medium | HLE with search | gemma-4-31b-it-qat-q4-0-unquantized | 56 | google/gemma-4-31B-it-qat-q4_0-unquantized | 26.5 | |
| gemma-4-12B-it-qat-w4a16-ct | medium | HLE with search | gemma-4-12b-it-qat-q4-0-unquantized | 57 | google/gemma-4-12B-it-qat-q4_0-unquantized | 26.5 | |
| gemma-4-31B-it-assistant | medium | HLE with search | gemma-4-31b-it-assistant | 58 | google/gemma-4-31B-it-assistant | 26.5 | |
| gemma-4-26B-A4B-it-GGUF | medium | HLE with search | gemma-4-26b-a4b-it | unsloth | 59 | google/gemma-4-26B-A4B-it | 26.5 |
| gemma-4-26B-A4B | medium | HLE with search | gemma-4-26b-a4b | 60 | google/gemma-4-26B-A4B | 26.5 | |
| gemma-4-31B | medium | HLE with search | gemma-4-31b | 61 | google/gemma-4-31B | 26.5 | |
| gemma-4-12b-it-GGUF | medium | HLE with search | gemma-4-12b-it | unsloth | 62 | google/gemma-4-12B-it | 26.5 |
| gemma-4-12B-it-qat-q4_0-unquantized | medium | HLE with search | gemma-4-12b-it | 63 | google/gemma-4-12B-it | 26.5 | |
| gemma-4-31B-it-GGUF | medium | HLE with search | gemma-4-31b-it | unsloth | 64 | google/gemma-4-31B-it | 26.5 |
| gemma-4-E4B-it-GGUF | medium | HLE with search | gemma-4-e4b-it | unsloth | 65 | google/gemma-4-E4B-it | 26.5 |
| gemma-4-E2B-it-qat-w4a16-ct | medium | HLE with search | gemma-4-e2b-it-qat-q4-0-unquantized | 66 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 26.5 | |
| gemma-4-26B-A4B-it-qat-GGUF | medium | HLE with search | gemma-4-26b-a4b-it-qat-q4-0-unquantized | unsloth | 67 | google/gemma-4-26B-A4B-it-qat-q4_0-unquantized | 26.5 |
| gemma-4-E4B-it-unsloth-bnb-4bit | medium | HLE with search | gemma-4-e4b-it | unsloth | 68 | google/gemma-4-E4B-it | 26.5 |
| gemma-4-E2B-it-GGUF | medium | HLE with search | gemma-4-e2b | unsloth | 69 | google/gemma-4-E2B-it | 26.5 |
| gemma-4-E4B-it-qat-w4a16-ct | medium | HLE with search | gemma-4-e4b-it-qat-q4-0-unquantized | 70 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 26.5 | |
| gemma-4-31B-it-unsloth-bnb-4bit | medium | HLE with search | gemma-4-31b-it | unsloth | 71 | google/gemma-4-31B-it | 26.5 |
| gemma-4-31B-it-qat-GGUF | medium | HLE with search | gemma-4-31b-it-qat-q4-0-unquantized | unsloth | 72 | google/gemma-4-31B-it-qat-q4_0-unquantized | 26.5 |
| gemma-4-12B | medium | HLE with search | gemma-4-12b | 73 | google/gemma-4-12B | 26.5 | |
| gemma-4-E4B-it-qat-GGUF | medium | HLE with search | gemma-4-e4b-it-qat-q4-0-unquantized | unsloth | 74 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 26.5 |
| gemma-4-26B-A4B-it-assistant | medium | HLE with search | gemma-4-26b-a4b-it-assistant | 75 | google/gemma-4-26B-A4B-it-assistant | 26.5 | |
| gemma-4-12B-it-qat-GGUF | medium | HLE with search | gemma-4-12b-it-qat-q4-0-unquantized | unsloth | 76 | google/gemma-4-12B-it-qat-q4_0-unquantized | 26.5 |
| gemma-4-12B-it-qat-q4_0-gguf | medium | HLE with search | gemma-4-12b-it-qat-q4-0-unquantized | 77 | google/gemma-4-12B-it-qat-q4_0-unquantized | 26.5 | |
| gemma-4-E4B | medium | HLE with search | gemma-4-e4b | 78 | google/gemma-4-E4B | 26.5 | |
| gemma-4-E4B-it-qat-q4_0-gguf | medium | HLE with search | gemma-4-e4b-it-qat-q4-0-unquantized | 79 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 26.5 | |
| gemma-4-E2B-it-qat-q4_0-gguf | medium | HLE with search | gemma-4-e2b-it-qat-q4-0-unquantized | 80 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 26.5 | |
| gemma-4-12B-it-assistant | medium | HLE with search | gemma-4-12b-it-assistant | 81 | google/gemma-4-12B-it-assistant | 26.5 | |
| gemma-4-E4B-it | medium | HLE with search | gemma-4-e4b-it | unsloth | 82 | google/gemma-4-E4B-it | 26.5 |
| gemma-4-12b-it | medium | HLE with search | gemma-4-12b-it | unsloth | 83 | google/gemma-4-12B-it | 26.5 |
| gemma-4-E2B-it-qat-GGUF | medium | HLE with search | gemma-4-e2b-it-qat-q4-0-unquantized | unsloth | 84 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 26.5 |
| gemma-4-12B-it-qat-q4_0-unquantized-assistant | medium | HLE with search | gemma-4-12b-it-assistant | 85 | google/gemma-4-12B-it-assistant | 26.5 | |
| gemma-4-26B-A4B-it-qat-q4_0-gguf | medium | HLE with search | gemma-4-26b-a4b-it-qat-q4-0-unquantized | 86 | google/gemma-4-26B-A4B-it-qat-q4_0-unquantized | 26.5 | |
| gemma-4-E2B | medium | HLE with search | gemma-4-e2b | 87 | google/gemma-4-E2B | 26.5 | |
| gemma-4-26B-A4B-it-NVFP4 | medium | HLE with search | gemma-4-26b-a4b-it | unsloth | 88 | google/gemma-4-26B-A4B-it | 26.5 |
| gemma-4-E2B-it-unsloth-bnb-4bit | medium | HLE with search | gemma-4-e2b | unsloth | 89 | google/gemma-4-E2B-it | 26.5 |
| gemma-4-31B-it-qat-q4_0-gguf | medium | HLE with search | gemma-4-31b-it-qat-q4-0-unquantized | 90 | google/gemma-4-31B-it-qat-q4_0-unquantized | 26.5 | |
| gemma-4-E2B-it | medium | HLE with search | gemma-4-e2b | unsloth | 91 | google/gemma-4-E2B-it | 26.5 |
| gemma-4-31B-it-qat-w4a16 | medium | HLE with search | gemma-4-31b-it-qat-q4-0-unquantized | unsloth | 92 | google/gemma-4-31B-it-qat-q4_0-unquantized | 26.5 |
| gemma-4-E2B-it-assistant | medium | HLE with search | gemma-4-e2b-it-assistant | 93 | google/gemma-4-E2B-it-assistant | 26.5 | |
| gemma-4-E4B-it-assistant | medium | HLE with search | gemma-4-e4b-it-assistant | 94 | google/gemma-4-E4B-it-assistant | 26.5 | |
| gemma-4-26B-A4B-it | medium | HLE with search | gemma-4-26b-a4b-it | unsloth | 95 | google/gemma-4-26B-A4B-it | 26.5 |
| gemma-4-E2B-it-qat-mobile-ct | medium | HLE with search | gemma-4-e2b-it-qat-mobile-transformers | 96 | google/gemma-4-E2B-it-qat-mobile-transformers | 26.5 | |
| gemma-4-E2B-it-qat-mobile-GGUF | medium | HLE with search | gemma-4-e2b-it-qat-mobile-transformers | unsloth | 97 | google/gemma-4-E2B-it-qat-mobile-transformers | 26.5 |
| gemma-4-26B-A4B-it-qat-q4_0-unquantized | medium | HLE with search | gemma-4-26b-a4b-it | 98 | google/gemma-4-26B-A4B-it | 26.5 | |
| gemma-4-E2B-it-qat-q4_0-unquantized | medium | HLE with search | gemma-4-e2b | 99 | google/gemma-4-E2B-it | 26.5 | |
| gemma-4-E4B-it-qat-mobile-ct | medium | HLE with search | gemma-4-e4b-it-qat-mobile-transformers | 100 | google/gemma-4-E4B-it-qat-mobile-transformers | 26.5 | |
| gemma-4-12b-it-NVFP4 | medium | HLE with search | gemma-4-12b-it | unsloth | 101 | google/gemma-4-12B-it | 26.5 |
| gemma-4-31B-it | medium | HLE with search | gemma-4-31b-it | unsloth | 102 | google/gemma-4-31B-it | 26.5 |
| gemma-4-E4B-it-qat-mobile-GGUF | medium | HLE with search | gemma-4-e4b-it-qat-mobile-transformers | unsloth | 103 | google/gemma-4-E4B-it-qat-mobile-transformers | 26.5 |
| gemma-4-31B-it-NVFP4 | medium | HLE with search | gemma-4-31b-it | unsloth | 104 | google/gemma-4-31B-it | 26.5 |
| gemma-4-12b | medium | HLE with search | gemma-4-12b | unsloth | 105 | google/gemma-4-12B | 26.5 |
| gemma-4-E2B-it-qat-mobile-transformers | medium | HLE with search | gemma-4-e2b | 106 | google/gemma-4-E2B-it | 26.5 | |
| gemma-4-E4B-it-qat-mobile-transformers | medium | HLE with search | gemma-4-e4b-it | 107 | google/gemma-4-E4B-it | 26.5 | |
| gemma-4-31B-it-qat-q4_0-unquantized-assistant | medium | HLE with search | gemma-4-31b-it-assistant | 108 | google/gemma-4-31B-it-assistant | 26.5 | |
| gemma-4-E4B-it-qat-q4_0-unquantized | medium | HLE with search | gemma-4-e4b-it | 109 | google/gemma-4-E4B-it | 26.5 | |
| gemma-4-26B-A4B-it-qat-q4_0-unquantized-assistant | medium | HLE with search | gemma-4-26b-a4b-it-assistant | 110 | google/gemma-4-26B-A4B-it-assistant | 26.5 | |
| gemma-4-31B-it-qat-q4_0-unquantized | medium | HLE with search | gemma-4-31b-it | 111 | google/gemma-4-31B-it | 26.5 | |
| gemma-4-E4B-it-NVFP4 | medium | HLE with search | gemma-4-e4b-it | unsloth | 112 | google/gemma-4-E4B-it | 26.5 |
| gemma-4-E2B-it-qat-q4_0-unquantized-assistant | medium | HLE with search | gemma-4-e2b-it-assistant | 113 | google/gemma-4-E2B-it-assistant | 26.5 | |
| gemma-4-E4B-it-qat-q4_0-unquantized-assistant | medium | HLE with search | gemma-4-e4b-it-assistant | 114 | google/gemma-4-E4B-it-assistant | 26.5 | |
| gemma-4-12B-it-qat-q4_0-unquantized | medium | HLE with search | gemma-4-12b-it | unsloth | 115 | google/gemma-4-12B-it | 26.5 |
| gemma-4-E2B | medium | HLE with search | gemma-4-e2b | unsloth | 116 | google/gemma-4-E2B | 26.5 |
| gemma-4-E2B-it-qat-q4_0-unquantized | medium | HLE with search | gemma-4-e2b | unsloth | 117 | google/gemma-4-E2B-it | 26.5 |
| gemma-4-E2B-it-NVFP4 | medium | HLE with search | gemma-4-e2b | unsloth | 118 | google/gemma-4-E2B-it | 26.5 |
| gemma-4-12B-it-qat-w4a16 | medium | HLE with search | gemma-4-12b-it-qat-q4-0-unquantized | unsloth | 119 | google/gemma-4-12B-it-qat-q4_0-unquantized | 26.5 |
| gemma-4-26B-A4B-it-qat-q4_0-unquantized | medium | HLE with search | gemma-4-26b-a4b-it | unsloth | 120 | google/gemma-4-26B-A4B-it | 26.5 |
| gemma-4-12B-it-GGUF | medium | HLE with search | gemma-4-12b | Mungert | 121 | google/gemma-4-12B | 26.5 |
| gemma-4-E4B-it-qat-w4a16 | medium | HLE with search | gemma-4-e4b-it-qat-q4-0-unquantized | unsloth | 122 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 26.5 |
| gemma-4-26b-a4b-it-UD-MLX-4bit | medium | HLE with search | gemma-4-26b-a4b-it | unsloth | 123 | google/gemma-4-26B-A4B-it | 26.5 |
| gemma-4-26B-A4B | medium | HLE with search | gemma-4-26b-a4b | unsloth | 124 | google/gemma-4-26B-A4B | 26.5 |
| gemma-4-31B-it-qat-q4_0-unquantized | medium | HLE with search | gemma-4-31b-it | unsloth | 125 | google/gemma-4-31B-it | 26.5 |
| gemma-4-E2B-it-qat-w4a16 | medium | HLE with search | gemma-4-e2b-it-qat-q4-0-unquantized | unsloth | 126 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 26.5 |
| gemma-4-E4B | medium | HLE with search | gemma-4-e4b | unsloth | 127 | google/gemma-4-E4B | 26.5 |
| gemma-4-E4B-it-qat-q4_0-unquantized | medium | HLE with search | gemma-4-e4b-it | unsloth | 128 | google/gemma-4-E4B-it | 26.5 |
| gemma-4-31B | medium | HLE with search | gemma-4-31b | unsloth | 129 | google/gemma-4-31B | 26.5 |
| gemma-4-E4B-it-UD-MLX-4bit | medium | HLE with search | gemma-4-e4b-it | unsloth | 130 | google/gemma-4-E4B-it | 26.5 |
| gemma-4-E2B-it-UD-MLX-4bit | medium | HLE with search | gemma-4-e2b | unsloth | 131 | google/gemma-4-E2B-it | 26.5 |
| gemma-4-31b-it-MLX-8bit | medium | HLE with search | gemma-4-31b-it | unsloth | 132 | google/gemma-4-31B-it | 26.5 |
| gemma-4-26b-a4b-it-MLX-8bit | medium | HLE with search | gemma-4-26b-a4b-it | unsloth | 133 | google/gemma-4-26B-A4B-it | 26.5 |
| gemma-4-31B-it-GGUF | medium | HLE with search | gemma-4-31b | Mungert | 134 | google/gemma-4-31B | 26.5 |
| gemma-4-E2B-it-qat-mobile | medium | HLE with search | gemma-4-e2b-it-qat-q4-0-unquantized | unsloth | 135 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 26.5 |
| gemma-4-E4B-it-MLX-8bit | medium | HLE with search | gemma-4-e4b-it | unsloth | 136 | google/gemma-4-E4B-it | 26.5 |
| gemma-4-31b-it-UD-MLX-4bit | medium | HLE with search | gemma-4-31b-it | unsloth | 137 | google/gemma-4-31B-it | 26.5 |
| gemma-4-E4B-it-GGUF | medium | HLE with search | gemma-4-e4b | Mungert | 138 | google/gemma-4-E4B | 26.5 |
| gemma-4-E2B-it-GGUF | medium | HLE with search | gemma-4-e2b | Mungert | 139 | google/gemma-4-E2B | 26.5 |
| gemma-4-E2B-it-MLX-8bit | medium | HLE with search | gemma-4-e2b | unsloth | 140 | google/gemma-4-E2B-it | 26.5 |
| gemma-4-26b-a4b-it-UD-MLX-3bit | medium | HLE with search | gemma-4-26b-a4b-it | unsloth | 141 | google/gemma-4-26B-A4B-it | 26.5 |
| gemma-4-E4B-it-qat-mobile | medium | HLE with search | gemma-4-e4b-it-qat-q4-0-unquantized | unsloth | 142 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 26.5 |
| gemma-4-31b-it-UD-MLX-3bit | medium | HLE with search | gemma-4-31b-it | unsloth | 143 | google/gemma-4-31B-it | 26.5 |
| GLM-4.7 | medium | HLE | glm-4-7 | zai-org | 144 | zai-org/GLM-4.7 | 24.8 |
| GLM-4.7-FP8 | medium | HLE | glm-4-7 | zai-org | 145 | zai-org/GLM-4.7 | 24.8 |
| GLM-4.7-GGUF | medium | HLE | glm-4-7 | unsloth | 146 | zai-org/GLM-4.7 | 24.8 |
| Kimi-K2-Thinking | medium | **HLE (Text-only)** | kimi-k2-thinking | moonshotai | 147 | moonshotai/Kimi-K2-Thinking | 23.9 |
| Kimi-K2-Thinking-GGUF | medium | **HLE (Text-only)** | kimi-k2-thinking | unsloth | 148 | moonshotai/Kimi-K2-Thinking | 23.9 |
| Kimi-K2-Thinking | medium | **HLE (Text-only)** | kimi-k2-thinking | unsloth | 149 | moonshotai/Kimi-K2-Thinking | 23.9 |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | medium | HLE (with tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 150 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 22.82 |
| NVIDIA-Nemotron-3-Super-120B-A12B-GGUF | medium | HLE (with tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 151 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 22.82 |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16-GGUF | medium | HLE (with tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | Mungert | 152 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 22.82 |
| NVIDIA-Nemotron-3-Super-120B-A12B | medium | HLE (with tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 153 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 22.82 |
| MiniMax-M2.1 | medium | HLE w/o tools | minimax-m2-1-reap-139b-a10b | MiniMaxAI | 154 | cerebras/MiniMax-M2.1-REAP-139B-A10B | 22.2 |
| MiniMax-M2.1-GGUF | medium | HLE w/o tools | minimax-m2-1 | unsloth | 155 | MiniMaxAI/MiniMax-M2.1 | 22.2 |
| MiniMax-M2.1 | medium | HLE w/o tools | minimax-m2-1 | unsloth | 156 | MiniMaxAI/MiniMax-M2.1 | 22.2 |
| MiMo-V2-Flash-GGUF | medium | HLE (no tools) | mimo-v2-flash | unsloth | 157 | XiaomiMiMo/MiMo-V2-Flash | 22.1 |
| DeepSeek-V3.2-Exp | medium | Humanity's Last Exam | deepseek-v3-2-exp-base | deepseek-ai | 158 | deepseek-ai/DeepSeek-V3.2-Exp-Base | 21.7 |
| Nanbeige4.1-3B-GGUF | low | Unknown | nanbeige4-3b-base | Mungert | 159 | Nanbeige/Nanbeige4-3B-Base | 21.5 |
| gemma-4-26B-A4B-it | medium | HLE no tools | gemma-4-26b-a4b | 160 | google/gemma-4-26B-A4B | 19.5 | |
| gemma-4-31B-it | medium | HLE no tools | gemma-4-31b | 161 | google/gemma-4-31B | 19.5 | |
| gemma-4-E4B-it | medium | HLE no tools | gemma-4-e4b | 162 | google/gemma-4-E4B | 19.5 | |
| gemma-4-E2B-it | medium | HLE no tools | gemma-4-e2b | 163 | google/gemma-4-E2B | 19.5 | |
| gemma-4-12B-it | medium | HLE no tools | gemma-4-12b | 164 | google/gemma-4-12B | 19.5 | |
| gemma-4-31B-it-qat-w4a16-ct | medium | HLE no tools | gemma-4-31b-it-qat-q4-0-unquantized | 165 | google/gemma-4-31B-it-qat-q4_0-unquantized | 19.5 | |
| gemma-4-12B-it-qat-w4a16-ct | medium | HLE no tools | gemma-4-12b-it-qat-q4-0-unquantized | 166 | google/gemma-4-12B-it-qat-q4_0-unquantized | 19.5 | |
| gemma-4-31B-it-assistant | medium | HLE no tools | gemma-4-31b-it-assistant | 167 | google/gemma-4-31B-it-assistant | 19.5 | |
| gemma-4-26B-A4B-it-GGUF | medium | HLE no tools | gemma-4-26b-a4b-it | unsloth | 168 | google/gemma-4-26B-A4B-it | 19.5 |
| gemma-4-26B-A4B | medium | HLE no tools | gemma-4-26b-a4b | 169 | google/gemma-4-26B-A4B | 19.5 | |
| gemma-4-31B | medium | HLE no tools | gemma-4-31b | 170 | google/gemma-4-31B | 19.5 | |
| gemma-4-12b-it-GGUF | medium | HLE no tools | gemma-4-12b-it | unsloth | 171 | google/gemma-4-12B-it | 19.5 |
| gemma-4-12B-it-qat-q4_0-unquantized | medium | HLE no tools | gemma-4-12b-it | 172 | google/gemma-4-12B-it | 19.5 | |
| gemma-4-31B-it-GGUF | medium | HLE no tools | gemma-4-31b-it | unsloth | 173 | google/gemma-4-31B-it | 19.5 |
| gemma-4-E4B-it-GGUF | medium | HLE no tools | gemma-4-e4b-it | unsloth | 174 | google/gemma-4-E4B-it | 19.5 |
| gemma-4-E2B-it-qat-w4a16-ct | medium | HLE no tools | gemma-4-e2b-it-qat-q4-0-unquantized | 175 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 19.5 | |
| gemma-4-26B-A4B-it-qat-GGUF | medium | HLE no tools | gemma-4-26b-a4b-it-qat-q4-0-unquantized | unsloth | 176 | google/gemma-4-26B-A4B-it-qat-q4_0-unquantized | 19.5 |
| gemma-4-E4B-it-unsloth-bnb-4bit | medium | HLE no tools | gemma-4-e4b-it | unsloth | 177 | google/gemma-4-E4B-it | 19.5 |
| gemma-4-E2B-it-GGUF | medium | HLE no tools | gemma-4-e2b | unsloth | 178 | google/gemma-4-E2B-it | 19.5 |
| gemma-4-E4B-it-qat-w4a16-ct | medium | HLE no tools | gemma-4-e4b-it-qat-q4-0-unquantized | 179 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 19.5 | |
| gemma-4-31B-it-unsloth-bnb-4bit | medium | HLE no tools | gemma-4-31b-it | unsloth | 180 | google/gemma-4-31B-it | 19.5 |
| gemma-4-31B-it-qat-GGUF | medium | HLE no tools | gemma-4-31b-it-qat-q4-0-unquantized | unsloth | 181 | google/gemma-4-31B-it-qat-q4_0-unquantized | 19.5 |
| gemma-4-12B | medium | HLE no tools | gemma-4-12b | 182 | google/gemma-4-12B | 19.5 | |
| gemma-4-E4B-it-qat-GGUF | medium | HLE no tools | gemma-4-e4b-it-qat-q4-0-unquantized | unsloth | 183 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 19.5 |
| gemma-4-26B-A4B-it-assistant | medium | HLE no tools | gemma-4-26b-a4b-it-assistant | 184 | google/gemma-4-26B-A4B-it-assistant | 19.5 | |
| gemma-4-12B-it-qat-GGUF | medium | HLE no tools | gemma-4-12b-it-qat-q4-0-unquantized | unsloth | 185 | google/gemma-4-12B-it-qat-q4_0-unquantized | 19.5 |
| gemma-4-12B-it-qat-q4_0-gguf | medium | HLE no tools | gemma-4-12b-it-qat-q4-0-unquantized | 186 | google/gemma-4-12B-it-qat-q4_0-unquantized | 19.5 | |
| gemma-4-E4B | medium | HLE no tools | gemma-4-e4b | 187 | google/gemma-4-E4B | 19.5 | |
| gemma-4-E4B-it-qat-q4_0-gguf | medium | HLE no tools | gemma-4-e4b-it-qat-q4-0-unquantized | 188 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 19.5 | |
| gemma-4-E2B-it-qat-q4_0-gguf | medium | HLE no tools | gemma-4-e2b-it-qat-q4-0-unquantized | 189 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 19.5 | |
| gemma-4-12B-it-assistant | medium | HLE no tools | gemma-4-12b-it-assistant | 190 | google/gemma-4-12B-it-assistant | 19.5 | |
| gemma-4-E4B-it | medium | HLE no tools | gemma-4-e4b-it | unsloth | 191 | google/gemma-4-E4B-it | 19.5 |
| gemma-4-12b-it | medium | HLE no tools | gemma-4-12b-it | unsloth | 192 | google/gemma-4-12B-it | 19.5 |
| gemma-4-E2B-it-qat-GGUF | medium | HLE no tools | gemma-4-e2b-it-qat-q4-0-unquantized | unsloth | 193 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 19.5 |
| gemma-4-12B-it-qat-q4_0-unquantized-assistant | medium | HLE no tools | gemma-4-12b-it-assistant | 194 | google/gemma-4-12B-it-assistant | 19.5 | |
| gemma-4-26B-A4B-it-qat-q4_0-gguf | medium | HLE no tools | gemma-4-26b-a4b-it-qat-q4-0-unquantized | 195 | google/gemma-4-26B-A4B-it-qat-q4_0-unquantized | 19.5 | |
| gemma-4-E2B | medium | HLE no tools | gemma-4-e2b | 196 | google/gemma-4-E2B | 19.5 | |
| gemma-4-26B-A4B-it-NVFP4 | medium | HLE no tools | gemma-4-26b-a4b-it | unsloth | 197 | google/gemma-4-26B-A4B-it | 19.5 |
| gemma-4-E2B-it-unsloth-bnb-4bit | medium | HLE no tools | gemma-4-e2b | unsloth | 198 | google/gemma-4-E2B-it | 19.5 |
| gemma-4-31B-it-qat-q4_0-gguf | medium | HLE no tools | gemma-4-31b-it-qat-q4-0-unquantized | 199 | google/gemma-4-31B-it-qat-q4_0-unquantized | 19.5 | |
| gemma-4-E2B-it | medium | HLE no tools | gemma-4-e2b | unsloth | 200 | google/gemma-4-E2B-it | 19.5 |
| gemma-4-31B-it-qat-w4a16 | medium | HLE no tools | gemma-4-31b-it-qat-q4-0-unquantized | unsloth | 201 | google/gemma-4-31B-it-qat-q4_0-unquantized | 19.5 |
| gemma-4-E2B-it-assistant | medium | HLE no tools | gemma-4-e2b-it-assistant | 202 | google/gemma-4-E2B-it-assistant | 19.5 | |
| gemma-4-E4B-it-assistant | medium | HLE no tools | gemma-4-e4b-it-assistant | 203 | google/gemma-4-E4B-it-assistant | 19.5 | |
| gemma-4-26B-A4B-it | medium | HLE no tools | gemma-4-26b-a4b-it | unsloth | 204 | google/gemma-4-26B-A4B-it | 19.5 |
| gemma-4-E2B-it-qat-mobile-ct | medium | HLE no tools | gemma-4-e2b-it-qat-mobile-transformers | 205 | google/gemma-4-E2B-it-qat-mobile-transformers | 19.5 | |
| gemma-4-E2B-it-qat-mobile-GGUF | medium | HLE no tools | gemma-4-e2b-it-qat-mobile-transformers | unsloth | 206 | google/gemma-4-E2B-it-qat-mobile-transformers | 19.5 |
| gemma-4-26B-A4B-it-qat-q4_0-unquantized | medium | HLE no tools | gemma-4-26b-a4b-it | 207 | google/gemma-4-26B-A4B-it | 19.5 | |
| gemma-4-E2B-it-qat-q4_0-unquantized | medium | HLE no tools | gemma-4-e2b | 208 | google/gemma-4-E2B-it | 19.5 | |
| gemma-4-E4B-it-qat-mobile-ct | medium | HLE no tools | gemma-4-e4b-it-qat-mobile-transformers | 209 | google/gemma-4-E4B-it-qat-mobile-transformers | 19.5 | |
| gemma-4-12b-it-NVFP4 | medium | HLE no tools | gemma-4-12b-it | unsloth | 210 | google/gemma-4-12B-it | 19.5 |
| gemma-4-31B-it | medium | HLE no tools | gemma-4-31b-it | unsloth | 211 | google/gemma-4-31B-it | 19.5 |
| gemma-4-E4B-it-qat-mobile-GGUF | medium | HLE no tools | gemma-4-e4b-it-qat-mobile-transformers | unsloth | 212 | google/gemma-4-E4B-it-qat-mobile-transformers | 19.5 |
| gemma-4-31B-it-NVFP4 | medium | HLE no tools | gemma-4-31b-it | unsloth | 213 | google/gemma-4-31B-it | 19.5 |
| gemma-4-12b | medium | HLE no tools | gemma-4-12b | unsloth | 214 | google/gemma-4-12B | 19.5 |
| gemma-4-E2B-it-qat-mobile-transformers | medium | HLE no tools | gemma-4-e2b | 215 | google/gemma-4-E2B-it | 19.5 | |
| gemma-4-E4B-it-qat-mobile-transformers | medium | HLE no tools | gemma-4-e4b-it | 216 | google/gemma-4-E4B-it | 19.5 | |
| gemma-4-31B-it-qat-q4_0-unquantized-assistant | medium | HLE no tools | gemma-4-31b-it-assistant | 217 | google/gemma-4-31B-it-assistant | 19.5 | |
| gemma-4-E4B-it-qat-q4_0-unquantized | medium | HLE no tools | gemma-4-e4b-it | 218 | google/gemma-4-E4B-it | 19.5 | |
| gemma-4-26B-A4B-it-qat-q4_0-unquantized-assistant | medium | HLE no tools | gemma-4-26b-a4b-it-assistant | 219 | google/gemma-4-26B-A4B-it-assistant | 19.5 | |
| gemma-4-31B-it-qat-q4_0-unquantized | medium | HLE no tools | gemma-4-31b-it | 220 | google/gemma-4-31B-it | 19.5 | |
| gemma-4-E4B-it-NVFP4 | medium | HLE no tools | gemma-4-e4b-it | unsloth | 221 | google/gemma-4-E4B-it | 19.5 |
| gemma-4-E2B-it-qat-q4_0-unquantized-assistant | medium | HLE no tools | gemma-4-e2b-it-assistant | 222 | google/gemma-4-E2B-it-assistant | 19.5 | |
| gemma-4-E4B-it-qat-q4_0-unquantized-assistant | medium | HLE no tools | gemma-4-e4b-it-assistant | 223 | google/gemma-4-E4B-it-assistant | 19.5 | |
| gemma-4-12B-it-qat-q4_0-unquantized | medium | HLE no tools | gemma-4-12b-it | unsloth | 224 | google/gemma-4-12B-it | 19.5 |
| gemma-4-E2B | medium | HLE no tools | gemma-4-e2b | unsloth | 225 | google/gemma-4-E2B | 19.5 |
| gemma-4-E2B-it-qat-q4_0-unquantized | medium | HLE no tools | gemma-4-e2b | unsloth | 226 | google/gemma-4-E2B-it | 19.5 |
| gemma-4-E2B-it-NVFP4 | medium | HLE no tools | gemma-4-e2b | unsloth | 227 | google/gemma-4-E2B-it | 19.5 |
| gemma-4-12B-it-qat-w4a16 | medium | HLE no tools | gemma-4-12b-it-qat-q4-0-unquantized | unsloth | 228 | google/gemma-4-12B-it-qat-q4_0-unquantized | 19.5 |
| gemma-4-26B-A4B-it-qat-q4_0-unquantized | medium | HLE no tools | gemma-4-26b-a4b-it | unsloth | 229 | google/gemma-4-26B-A4B-it | 19.5 |
| gemma-4-12B-it-GGUF | medium | HLE no tools | gemma-4-12b | Mungert | 230 | google/gemma-4-12B | 19.5 |
| gemma-4-E4B-it-qat-w4a16 | medium | HLE no tools | gemma-4-e4b-it-qat-q4-0-unquantized | unsloth | 231 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 19.5 |
| gemma-4-26b-a4b-it-UD-MLX-4bit | medium | HLE no tools | gemma-4-26b-a4b-it | unsloth | 232 | google/gemma-4-26B-A4B-it | 19.5 |
| gemma-4-26B-A4B | medium | HLE no tools | gemma-4-26b-a4b | unsloth | 233 | google/gemma-4-26B-A4B | 19.5 |
| gemma-4-31B-it-qat-q4_0-unquantized | medium | HLE no tools | gemma-4-31b-it | unsloth | 234 | google/gemma-4-31B-it | 19.5 |
| gemma-4-E2B-it-qat-w4a16 | medium | HLE no tools | gemma-4-e2b-it-qat-q4-0-unquantized | unsloth | 235 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 19.5 |
| gemma-4-E4B | medium | HLE no tools | gemma-4-e4b | unsloth | 236 | google/gemma-4-E4B | 19.5 |
| gemma-4-E4B-it-qat-q4_0-unquantized | medium | HLE no tools | gemma-4-e4b-it | unsloth | 237 | google/gemma-4-E4B-it | 19.5 |
| gemma-4-31B | medium | HLE no tools | gemma-4-31b | unsloth | 238 | google/gemma-4-31B | 19.5 |
| gemma-4-E4B-it-UD-MLX-4bit | medium | HLE no tools | gemma-4-e4b-it | unsloth | 239 | google/gemma-4-E4B-it | 19.5 |
| gemma-4-E2B-it-UD-MLX-4bit | medium | HLE no tools | gemma-4-e2b | unsloth | 240 | google/gemma-4-E2B-it | 19.5 |
| gemma-4-31b-it-MLX-8bit | medium | HLE no tools | gemma-4-31b-it | unsloth | 241 | google/gemma-4-31B-it | 19.5 |
| gemma-4-26b-a4b-it-MLX-8bit | medium | HLE no tools | gemma-4-26b-a4b-it | unsloth | 242 | google/gemma-4-26B-A4B-it | 19.5 |
| gemma-4-31B-it-GGUF | medium | HLE no tools | gemma-4-31b | Mungert | 243 | google/gemma-4-31B | 19.5 |
| gemma-4-E2B-it-qat-mobile | medium | HLE no tools | gemma-4-e2b-it-qat-q4-0-unquantized | unsloth | 244 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 19.5 |
| gemma-4-E4B-it-MLX-8bit | medium | HLE no tools | gemma-4-e4b-it | unsloth | 245 | google/gemma-4-E4B-it | 19.5 |
| gemma-4-31b-it-UD-MLX-4bit | medium | HLE no tools | gemma-4-31b-it | unsloth | 246 | google/gemma-4-31B-it | 19.5 |
| gemma-4-E4B-it-GGUF | medium | HLE no tools | gemma-4-e4b | Mungert | 247 | google/gemma-4-E4B | 19.5 |
| gemma-4-E2B-it-GGUF | medium | HLE no tools | gemma-4-e2b | Mungert | 248 | google/gemma-4-E2B | 19.5 |
| gemma-4-E2B-it-MLX-8bit | medium | HLE no tools | gemma-4-e2b | unsloth | 249 | google/gemma-4-E2B-it | 19.5 |
| gemma-4-26b-a4b-it-UD-MLX-3bit | medium | HLE no tools | gemma-4-26b-a4b-it | unsloth | 250 | google/gemma-4-26B-A4B-it | 19.5 |
| gemma-4-E4B-it-qat-mobile | medium | HLE no tools | gemma-4-e4b-it-qat-q4-0-unquantized | unsloth | 251 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 19.5 |
| gemma-4-31b-it-UD-MLX-3bit | medium | HLE no tools | gemma-4-31b-it | unsloth | 252 | google/gemma-4-31B-it | 19.5 |
| MiniMax-M2.5 | medium | HLE w/o tools | minimax-m2-5 | MiniMaxAI | 253 | MiniMaxAI/MiniMax-M2.5 | 19.4 |
| MiniMax-M2.5-GGUF | medium | HLE w/o tools | minimax-m2-5 | unsloth | 254 | MiniMaxAI/MiniMax-M2.5 | 19.4 |
| NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 | medium | HLE (no tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 255 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 18.26 |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | medium | HLE (no tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 256 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 18.26 |
| NVIDIA-Nemotron-3-Super-120B-A12B-FP8 | medium | HLE (no tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 257 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 18.26 |
| NVIDIA-Nemotron-3-Super-120B-A12B-GGUF | medium | HLE (no tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 258 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 18.26 |
| NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 | medium | HLE (no tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 259 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 18.26 |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16-GGUF | medium | HLE (no tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | Mungert | 260 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 18.26 |
| NVIDIA-Nemotron-3-Super-120B-A12B | medium | HLE (no tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 261 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 18.26 |
| NVIDIA-Nemotron-3-Super-120B-A12B-FP8 | medium | HLE (no tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 262 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 18.26 |
| Qwen3-235B-A22B-Thinking-2507-FP8 | medium | HLE | qwen3-235b-a22b-thinking-2507 | Qwen | 263 | Qwen/Qwen3-235B-A22B-Thinking-2507 | 18.1 |
| Qwen3-235B-A22B-Thinking-2507 | medium | HLE | qwen3-235b-a22b-thinking-2507 | Qwen | 264 | Qwen/Qwen3-235B-A22B-Thinking-2507 | 18.1 |
| Qwen3-235B-A22B-Thinking-2507-GGUF | medium | HLE | qwen3-235b-a22b-thinking-2507 | unsloth | 265 | Qwen/Qwen3-235B-A22B-Thinking-2507 | 18.1 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4 | medium | HLE (no tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 266 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 16.5 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-FP8 | medium | HLE (no tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 267 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 16.5 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16 | medium | HLE (no tools) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 268 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 16.5 |
| DeepSeek-V3.1-Terminus | medium | Humanity's Last Exam | deepseek-v3-1-base | deepseek-ai | 269 | deepseek-ai/DeepSeek-V3.1-Base | 15.9 |
| DeepSeek-V3.1-Terminus-GGUF | medium | Humanity's Last Exam | deepseek-v3-1-terminus | unsloth | 270 | deepseek-ai/DeepSeek-V3.1-Terminus | 15.9 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | medium | HLE (with tools) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 271 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 15.5 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 | medium | HLE (with tools) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 272 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 15.5 |
| Nemotron-3-Nano-30B-A3B-GGUF | medium | HLE (with tools) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 273 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 15.5 |
| Nemotron-3-Nano-30B-A3B | medium | HLE (with tools) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 274 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 15.5 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF | medium | HLE (with tools) | nvidia-nemotron-3-nano-30b-a3b-bf16 | Mungert | 275 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 15.5 |
| Nemotron-3-Nano-30B-A3B-FP8 | medium | HLE (with tools) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 276 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 15.5 |
| GLM-4.7-Flash | medium | HLE | glm-4-7-flash | zai-org | 277 | zai-org/GLM-4.7-Flash | 14.4 |
| GLM-4.7-Flash | medium | HLE | glm-4-7-flash | unsloth | 278 | zai-org/GLM-4.7-Flash | 14.4 |
| GLM-4.7-Flash-FP8-Dynamic | medium | HLE | glm-4-7-flash | unsloth | 279 | zai-org/GLM-4.7-Flash | 14.4 |
| GLM-4.7-Flash-GGUF | medium | HLE | glm-4-7-flash | unsloth | 280 | zai-org/GLM-4.7-Flash | 14.4 |
| GLM-4.7-Flash-NVFP4 | medium | HLE | glm-4-7-flash | unsloth | 281 | zai-org/GLM-4.7-Flash | 14.4 |
| GLM-4.7-Flash-GGUF | medium | HLE | glm-4-7-flash | Mungert | 282 | zai-org/GLM-4.7-Flash | 14.4 |
| MiniMax-M2 | medium | HLE (w/o tools) | minimax-m2 | MiniMaxAI | 283 | MiniMaxAI/MiniMax-M2 | 12.5 |
| MiniMax-M2-GGUF | medium | HLE (w/o tools) | minimax-m2 | unsloth | 284 | MiniMaxAI/MiniMax-M2 | 12.5 |
| diffusiongemma-26B-A4B-it | medium | HLE with search | diffusiongemma-26b-a4b-it | 285 | google/diffusiongemma-26B-A4B-it | 11.9 | |
| diffusiongemma-26B-A4B-it-GGUF | medium | HLE with search | diffusiongemma-26b-a4b-it | unsloth | 286 | google/diffusiongemma-26B-A4B-it | 11.9 |
| diffusiongemma-26B-A4B-it | medium | HLE with search | diffusiongemma-26b-a4b-it | unsloth | 287 | google/diffusiongemma-26B-A4B-it | 11.9 |
| OpenReasoning-Nemotron-32B | medium | **HLE** | qwen2-5-32b | nvidia | 288 | Qwen/Qwen2.5-32B | 11.8 |
| OpenReasoning-Nemotron-1.5B | medium | **HLE** | qwen2-5-1-5b | nvidia | 289 | Qwen/Qwen2.5-1.5B | 11.8 |
| OpenReasoning-Nemotron-14B | medium | **HLE** | qwen2-5-14b | nvidia | 290 | Qwen/Qwen2.5-14B | 11.8 |
| OpenReasoning-Nemotron-7B | medium | **HLE** | qwen2-5-7b | nvidia | 291 | Qwen/Qwen2.5-7B | 11.8 |
| OpenReasoning-Nemotron-32B-GGUF | medium | **HLE** | qwen2-5-32b | unsloth | 292 | nvidia/OpenReasoning-Nemotron-32B | 11.8 |
| OpenReasoning-Nemotron-7B-GGUF | medium | **HLE** | qwen2-5-7b-instruct | Mungert | 293 | Qwen/Qwen2.5-7B-Instruct | 11.8 |
| OpenReasoning-Nemotron-1.5B-GGUF | medium | **HLE** | qwen2-5-1-5b-instruct | Mungert | 294 | Qwen/Qwen2.5-1.5B-Instruct | 11.8 |
| OpenReasoning-Nemotron-14B-GGUF | medium | **HLE** | qwen2-5-14b | Mungert | 295 | Qwen/Qwen2.5-14B-Instruct | 11.8 |
| OpenReasoning-Nemotron-32B-GGUF | medium | **HLE** | qwen2-5-32b-instruct | Mungert | 296 | Qwen/Qwen2.5-32B-Instruct | 11.8 |
| diffusiongemma-26B-A4B-it | medium | HLE no tools | diffusiongemma-26b-a4b-it | 297 | google/diffusiongemma-26B-A4B-it | 11 | |
| diffusiongemma-26B-A4B-it-GGUF | medium | HLE no tools | diffusiongemma-26b-a4b-it | unsloth | 298 | google/diffusiongemma-26B-A4B-it | 11 |
| diffusiongemma-26B-A4B-it | medium | HLE no tools | diffusiongemma-26b-a4b-it | unsloth | 299 | google/diffusiongemma-26B-A4B-it | 11 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | medium | HLE (no tools) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 300 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 10.6 |
| Nemotron-3-Nano-30B-A3B-GGUF | medium | HLE (no tools) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 301 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 10.6 |
| Nemotron-3-Nano-30B-A3B | medium | HLE (no tools) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 302 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 10.6 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF | medium | HLE (no tools) | nvidia-nemotron-3-nano-30b-a3b-bf16 | Mungert | 303 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 10.6 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | medium | HLE (no tools) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 304 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 10.2 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 | medium | HLE (no tools) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 305 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 10.2 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | medium | HLE (no tools) | nvidia-nemotron-3-nano-30b-a3b-nvfp4 | unsloth | 306 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | 10.2 |
| Nemotron-3-Nano-30B-A3B-FP8 | medium | HLE (no tools) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 307 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 10.2 |
| OpenMath-Nemotron-1.5B | low | Unknown | qwen2-5-math-1-5b | nvidia | 308 | Qwen/Qwen2.5-Math-1.5B | 7.9 |
| OpenMath-Nemotron-7B | low | Unknown | qwen2-5-math-7b | nvidia | 309 | Qwen/Qwen2.5-Math-7B | 7.9 |
| OpenMath-Nemotron-32B | low | Unknown | qwen2-5-32b | nvidia | 310 | Qwen/Qwen2.5-32B | 7.9 |
| OpenMath-Nemotron-14B | low | Unknown | qwen2-5-14b | nvidia | 311 | Qwen/Qwen2.5-14B | 7.9 |
| OpenMath-Nemotron-1.5B-GGUF | low | Unknown | qwen2-5-math-1-5b | Mungert | 312 | Qwen/Qwen2.5-Math-1.5B | 7.9 |
| OpenMath-Nemotron-14B-Kaggle | low | Unknown | qwen2-5-14b | nvidia | 313 | Qwen/Qwen2.5-14B | 7.9 |
| OpenMath-Nemotron-32B-GGUF | low | Unknown | qwen2-5-32b | Mungert | 314 | Qwen/Qwen2.5-32B | 7.9 |
| OpenMath-Nemotron-14B-Kaggle-GGUF | low | Unknown | qwen2-5-14b | Mungert | 315 | Qwen/Qwen2.5-14B | 7.9 |
| OpenMath-Nemotron-7B-GGUF | low | Unknown | qwen2-5-math-7b | Mungert | 316 | Qwen/Qwen2.5-Math-7B | 7.9 |
| Nanbeige4.1-3B-GGUF | medium | HLE (Text-only) | nanbeige4-3b-base | Mungert | 317 | Nanbeige/Nanbeige4-3B-Base | 6.72 |
| NVIDIA-Nemotron-Nano-9B-v2-Japanese | medium | HLE | nvidia-nemotron-nano-12b-v2-base | nvidia | 318 | nvidia/NVIDIA-Nemotron-Nano-9B-v2 | 5.7 |
| OpenReasoning-Nemotron-32B | low | Unknown | qwen2-5-32b | nvidia | 319 | Qwen/Qwen2.5-32B | 5.5 |
| OpenReasoning-Nemotron-1.5B | low | Unknown | qwen2-5-1-5b | nvidia | 320 | Qwen/Qwen2.5-1.5B | 5.5 |
| OpenReasoning-Nemotron-14B | low | Unknown | qwen2-5-14b | nvidia | 321 | Qwen/Qwen2.5-14B | 5.5 |
| OpenReasoning-Nemotron-7B | low | Unknown | qwen2-5-7b | nvidia | 322 | Qwen/Qwen2.5-7B | 5.5 |
| OpenReasoning-Nemotron-32B-GGUF | low | Unknown | qwen2-5-32b | unsloth | 323 | nvidia/OpenReasoning-Nemotron-32B | 5.5 |
| OpenReasoning-Nemotron-7B-GGUF | low | Unknown | qwen2-5-7b-instruct | Mungert | 324 | Qwen/Qwen2.5-7B-Instruct | 5.5 |
| OpenReasoning-Nemotron-1.5B-GGUF | low | Unknown | qwen2-5-1-5b-instruct | Mungert | 325 | Qwen/Qwen2.5-1.5B-Instruct | 5.5 |
| OpenReasoning-Nemotron-14B-GGUF | low | Unknown | qwen2-5-14b | Mungert | 326 | Qwen/Qwen2.5-14B-Instruct | 5.5 |
| OpenReasoning-Nemotron-32B-GGUF | low | Unknown | qwen2-5-32b-instruct | Mungert | 327 | Qwen/Qwen2.5-32B-Instruct | 5.5 |
| pokee_research_7b-GGUF | low | Unknown | qwen2-5-7b-instruct | Mungert | 328 | Qwen/Qwen2.5-7B-Instruct | 5.4 |
| NVIDIA-Nemotron-Nano-9B-v2 | medium | HLE | nvidia-nemotron-nano-12b-v2-base | nvidia | 329 | nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base | 4.4 |
| NVIDIA-Nemotron-Nano-9B-v2 | medium | HLE | nvidia-nemotron-nano-12b-v2-base | unsloth | 330 | nvidia/NVIDIA-Nemotron-Nano-9B-v2 | 4.4 |
Provenance & metadata (1)
source
- kind
- leaderboard-scrape
- paths
- benchmarks/hle.html