Leaderboard
RULER
rulerRecord
- Category
- long-context
- Scored models
- 109
Scores
| Model | Score |
|---|---|
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.79 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.79 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.79 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.79 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.6 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.6 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.6 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.6 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.3 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.3 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.3 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.3 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.09 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.09 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.09 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.09 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 95.67 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 95.67 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 95.67 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 95.67 |
| nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | 95.3 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 95.1 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 95.1 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 95.1 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- long-context
- id
- ruler
- name
- RULER
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 | medium | RULER-500 @ 128k (500 samples per task) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 1 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.79 |
| NVIDIA-Nemotron-3-Super-120B-A12B-FP8 | medium | RULER-500 @ 128k (500 samples per task) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 2 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.79 |
| NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 | medium | RULER-500 @ 128k (500 samples per task) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 3 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.79 |
| NVIDIA-Nemotron-3-Super-120B-A12B-FP8 | medium | RULER-500 @ 128k (500 samples per task) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 4 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.79 |
| NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 | medium | RULER-500 @ 256k (500 samples per task) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 5 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.6 |
| NVIDIA-Nemotron-3-Super-120B-A12B-FP8 | medium | RULER-500 @ 256k (500 samples per task) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 6 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.6 |
| NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 | medium | RULER-500 @ 256k (500 samples per task) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 7 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.6 |
| NVIDIA-Nemotron-3-Super-120B-A12B-FP8 | medium | RULER-500 @ 256k (500 samples per task) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 8 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.6 |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | medium | RULER @ 256k | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 9 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.3 |
| NVIDIA-Nemotron-3-Super-120B-A12B-GGUF | medium | RULER @ 256k | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 10 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.3 |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16-GGUF | medium | RULER @ 256k | nvidia-nemotron-3-super-120b-a12b-bf16 | Mungert | 11 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.3 |
| NVIDIA-Nemotron-3-Super-120B-A12B | medium | RULER @ 256k | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 12 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.3 |
| NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 | medium | RULER-500 @ 512k (500 samples per task) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 13 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.09 |
| NVIDIA-Nemotron-3-Super-120B-A12B-FP8 | medium | RULER-500 @ 512k (500 samples per task) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 14 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.09 |
| NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 | medium | RULER-500 @ 512k (500 samples per task) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 15 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.09 |
| NVIDIA-Nemotron-3-Super-120B-A12B-FP8 | medium | RULER-500 @ 512k (500 samples per task) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 16 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 96.09 |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | medium | RULER @ 512k | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 17 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 95.67 |
| NVIDIA-Nemotron-3-Super-120B-A12B-GGUF | medium | RULER @ 512k | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 18 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 95.67 |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16-GGUF | medium | RULER @ 512k | nvidia-nemotron-3-super-120b-a12b-bf16 | Mungert | 19 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 95.67 |
| NVIDIA-Nemotron-3-Super-120B-A12B | medium | RULER @ 512k | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 20 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 95.67 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | medium | RULER 64K | nvidia-nemotron-3-ultra-550b-a55b-base-bf16 | nvidia | 21 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | 95.3 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4 | medium | RULER @ 256k | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 22 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 95.1 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-FP8 | medium | RULER @ 256k | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 23 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 95.1 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16 | medium | RULER @ 256k | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 24 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 95.1 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | medium | RULER (1M) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | nvidia | 25 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 94.7 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | medium | RULER 1M | nvidia-nemotron-3-ultra-550b-a55b-bf16 | nvidia | 26 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 94.7 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-GGUF | medium | RULER (1M) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | unsloth | 27 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 94.7 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | medium | RULER (1M) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | unsloth | 28 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 94.7 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4 | medium | RULER @ 512k | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 29 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 94.2 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-FP8 | medium | RULER @ 512k | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 30 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 94.2 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16 | medium | RULER @ 512k | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 31 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 94.2 |
| Mistral-Small-3.1-24B-Instruct-2503 | low | RULER 32K | RULER 128K | mistral-small-3-1-24b-base-2503 | mistralai | 32 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 93.96 |
| Mistral-Small-3.1-24B-Instruct-2503-GGUF | low | RULER 32K | RULER 128K | mistral-small-3-1-24b-instruct-2503 | unsloth | 33 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 93.96 |
| Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low | RULER 32K | RULER 128K | mistral-small-3-1-24b-instruct-2503 | unsloth | 34 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 93.96 |
| Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low | RULER 32K | RULER 128K | mistral-small-3-1-24b-instruct-2503 | unsloth | 35 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 93.96 |
| Mistral-Small-3.1-24B-Instruct-2503 | low | RULER 32K | RULER 128K | mistral-small-3-1-24b-instruct-2503 | unsloth | 36 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 93.96 |
| Mistral-Small-3.1-24B-Instruct-2503-GGUF | low | RULER 32K | RULER 128K | mistral-small-3-1-24b-base-2503 | Mungert | 37 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 93.96 |
| NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16 | medium | RULER 64K | nvidia-nemotron-3-super-120b-a12b-base-bf16 | nvidia | 38 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16 | 93.17 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | medium | RULER-100@256k | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 39 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 92.9 |
| Nemotron-3-Nano-30B-A3B-GGUF | medium | RULER-100@256k | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 40 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 92.9 |
| Nemotron-3-Nano-30B-A3B | medium | RULER-100@256k | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 41 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 92.9 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF | medium | RULER-100@256k | nvidia-nemotron-3-nano-30b-a3b-bf16 | Mungert | 42 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 92.9 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | medium | RULER 128K | nvidia-nemotron-3-ultra-550b-a55b-base-bf16 | nvidia | 43 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | 92.49 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4 | medium | RULER @ 1M | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 44 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 92.2 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-FP8 | medium | RULER @ 1M | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 45 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 92.2 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16 | medium | RULER @ 1M | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 46 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 92.2 |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | medium | RULER @ 1M | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 47 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 91.75 |
| NVIDIA-Nemotron-3-Super-120B-A12B-GGUF | medium | RULER @ 1M | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 48 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 91.75 |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16-GGUF | medium | RULER @ 1M | nvidia-nemotron-3-super-120b-a12b-bf16 | Mungert | 49 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 91.75 |
| NVIDIA-Nemotron-3-Super-120B-A12B | medium | RULER @ 1M | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 50 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 91.75 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | medium | RULER-100@512k | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 51 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 91.3 |
| Nemotron-3-Nano-30B-A3B-GGUF | medium | RULER-100@512k | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 52 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 91.3 |
| Nemotron-3-Nano-30B-A3B | medium | RULER-100@512k | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 53 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 91.3 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF | medium | RULER-100@512k | nvidia-nemotron-3-nano-30b-a3b-bf16 | Mungert | 54 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 91.3 |
| NVIDIA-Nemotron-3-Nano-4B-BF16 | medium | RULER (128k) | nvidia-nemotron-nano-12b-v2-base | nvidia | 55 | nvidia/NVIDIA-Nemotron-Nano-9B-v2 | 91.1 |
| NVIDIA-Nemotron-3-Nano-4B-FP8 | medium | RULER (128k) | nvidia-nemotron-nano-9b-v2 | nvidia | 56 | nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 | 91.1 |
| NVIDIA-Nemotron-3-Nano-4B-GGUF | medium | RULER (128k) | nvidia-nemotron-3-nano-4b-fp8 | nvidia | 57 | nvidia/NVIDIA-Nemotron-3-Nano-4B-FP8 | 91.1 |
| NVIDIA-Nemotron-3-Nano-4B | medium | RULER (128k) | nvidia-nemotron-nano-9b-v2 | unsloth | 58 | nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 | 91.1 |
| NVIDIA-Nemotron-3-Nano-4B-GGUF | medium | RULER (128k) | nvidia-nemotron-nano-9b-v2 | unsloth | 59 | nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 | 91.1 |
| NVIDIA-Nemotron-3-Nano-4B-FP8 | medium | RULER (128k) | nvidia-nemotron-nano-9b-v2 | unsloth | 60 | nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 | 91.1 |
| NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16 | medium | RULER 128K | nvidia-nemotron-3-super-120b-a12b-base-bf16 | nvidia | 61 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16 | 89 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | medium | RULER-100@1M | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 62 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 86.3 |
| Nemotron-3-Nano-30B-A3B-GGUF | medium | RULER-100@1M | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 63 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 86.3 |
| Nemotron-3-Nano-30B-A3B | medium | RULER-100@1M | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 64 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 86.3 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF | medium | RULER-100@1M | nvidia-nemotron-3-nano-30b-a3b-bf16 | Mungert | 65 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 86.3 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | medium | RULER 256K | nvidia-nemotron-3-ultra-550b-a55b-base-bf16 | nvidia | 66 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | 86.22 |
| NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16 | medium | RULER 256K | nvidia-nemotron-3-super-120b-a12b-base-bf16 | nvidia | 67 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16 | 86.18 |
| NVIDIA-Nemotron-Nano-9B-v2-Base | medium | RULER-128K | nvidia-nemotron-nano-9b-v2-base | nvidia | 68 | nvidia/NVIDIA-Nemotron-Nano-9B-v2-Base | 84.74 |
| NVIDIA-Nemotron-Nano-12B-v2-Base | medium | RULER-128K | nvidia-nemotron-nano-12b-v2-base | nvidia | 69 | nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base | 84.74 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | medium | RULER 512K | nvidia-nemotron-3-ultra-550b-a55b-base-bf16 | nvidia | 70 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | 84.54 |
| Llama-3_1-Nemotron-Ultra-253B-CPT-v1 | medium | RULER | Unknown | nvidia | 71 | nvidia/Llama-3_1-Nemotron-Ultra-253B-CPT-v1 | 83.21 |
| NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16 | medium | RULER 512K | nvidia-nemotron-3-super-120b-a12b-base-bf16 | nvidia | 72 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16 | 82.16 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | medium | RULER 1M | nvidia-nemotron-3-ultra-550b-a55b-base-bf16 | nvidia | 73 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | 76.83 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16 | medium | RULER (256K, 0-shot, acc) | nvidia-nemotron-3-nano-30b-a3b-base-bf16 | nvidia | 74 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16 | 75.44 |
| NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16 | medium | RULER 1M | nvidia-nemotron-3-super-120b-a12b-base-bf16 | nvidia | 75 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16 | 74.39 |
| NVIDIA-Nemotron-Nano-9B-v2 | medium | RULER (128K) | nvidia-nemotron-nano-12b-v2-base | nvidia | 76 | nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base | 74.1 |
| NVIDIA-Nemotron-Nano-9B-v2-FP8 | medium | RULER (128K) | nvidia-nemotron-nano-12b-v2-base | nvidia | 77 | nvidia/NVIDIA-Nemotron-Nano-9B-v2 | 74.1 |
| NVIDIA-Nemotron-Nano-9B-v2-NVFP4 | medium | RULER (128K) | nvidia-nemotron-nano-12b-v2-base | nvidia | 78 | nvidia/NVIDIA-Nemotron-Nano-9B-v2 | 74.1 |
| NVIDIA-Nemotron-Nano-9B-v2 | medium | RULER (128K) | nvidia-nemotron-nano-12b-v2-base | unsloth | 79 | nvidia/NVIDIA-Nemotron-Nano-9B-v2 | 74.1 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16 | medium | RULER (512K, 0-shot, acc) | nvidia-nemotron-3-nano-30b-a3b-base-bf16 | nvidia | 80 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16 | 70.56 |
| Qwen3-8B-DMS-8x | medium | RULER 64K | qwen3-8b-base | nvidia | 81 | Qwen/Qwen3-8B | 69.2 |
| SmolLM3-3B-GGUF | medium | Unknown | smollm3-3b | ggml-org | 82 | HuggingFaceTB/SmolLM3-3B | 64 |
| NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16 | medium | Unknown | nvidia-nemotron-3-super-120b-a12b-base-bf16 | nvidia | 83 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16 | 64 |
| SmolLM3-3B-GGUF | medium | Unknown | smollm3-3b | unsloth | 84 | HuggingFaceTB/SmolLM3-3B | 64 |
| SmolLM3-3B-128K-GGUF | medium | Unknown | smollm3-3b | unsloth | 85 | HuggingFaceTB/SmolLM3-3B | 64 |
| SmolLM3-3B | medium | Unknown | smollm3-3b | unsloth | 86 | HuggingFaceTB/SmolLM3-3B | 64 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | medium | Unknown | nvidia-nemotron-3-ultra-550b-a55b-base-bf16 | nvidia | 87 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | 64 |
| SmolLM3-3B-Base | medium | Unknown | Unknown | unsloth | 88 | HuggingFaceTB/SmolLM3-3B-Base | 64 |
| Qwen3-8B-DMS-8x | medium | Unknown | qwen3-8b-base | nvidia | 89 | Qwen/Qwen3-8B | 64 |
| SmolLM3-3B-bnb-4bit | medium | Unknown | smollm3-3b | unsloth | 90 | HuggingFaceTB/SmolLM3-3B | 64 |
| SmolLM3-3B-GGUF | medium | Unknown | smollm3-3b | Mungert | 91 | HuggingFaceTB/SmolLM3-3B | 64 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16 | medium | RULER (64K, 0-shot, acc) | nvidia-nemotron-3-nano-30b-a3b-base-bf16 | nvidia | 92 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16 | 63.55 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16 | medium | RULER (128K, 0-shot, acc) | nvidia-nemotron-3-nano-30b-a3b-base-bf16 | nvidia | 93 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16 | 60.69 |
| t5gemma-2-270m-270m | medium | [Ruler 32K] | t5gemma-2-270m-270m | 94 | google/t5gemma-2-270m-270m | 57.3 | |
| t5gemma-2-4b-4b | medium | [Ruler 32K] | t5gemma-2-4b-4b | 95 | google/t5gemma-2-4b-4b | 57.3 | |
| t5gemma-2-1b-1b | medium | [Ruler 32K] | t5gemma-2-1b-1b | 96 | google/t5gemma-2-1b-1b | 57.3 | |
| Mistral-Small-3.1-24B-Instruct-2503 | medium | Unknown | mistral-small-3-1-24b-base-2503 | mistralai | 97 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 32 |
| t5gemma-2-270m-270m | medium | Unknown | t5gemma-2-270m-270m | 98 | google/t5gemma-2-270m-270m | 32 | |
| t5gemma-2-4b-4b | medium | Unknown | t5gemma-2-4b-4b | 99 | google/t5gemma-2-4b-4b | 32 | |
| t5gemma-2-1b-1b | medium | Unknown | t5gemma-2-1b-1b | 100 | google/t5gemma-2-1b-1b | 32 | |
| Mistral-Small-3.1-24B-Instruct-2503-GGUF | medium | Unknown | mistral-small-3-1-24b-instruct-2503 | unsloth | 101 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 32 |
| Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | medium | Unknown | mistral-small-3-1-24b-instruct-2503 | unsloth | 102 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 32 |
| Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | medium | Unknown | mistral-small-3-1-24b-instruct-2503 | unsloth | 103 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 32 |
| Mistral-Small-3.1-24B-Instruct-2503 | medium | Unknown | mistral-small-3-1-24b-instruct-2503 | unsloth | 104 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 32 |
| Mistral-Small-3.1-24B-Instruct-2503-GGUF | medium | Unknown | mistral-small-3-1-24b-base-2503 | Mungert | 105 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 32 |
| t5gemma-2-270m-270m | medium | [Ruler 128K] | t5gemma-2-270m-270m | 106 | google/t5gemma-2-270m-270m | 25.5 | |
| t5gemma-2-4b-4b | medium | [Ruler 128K] | t5gemma-2-4b-4b | 107 | google/t5gemma-2-4b-4b | 25.5 | |
| t5gemma-2-1b-1b | medium | [Ruler 128K] | t5gemma-2-1b-1b | 108 | google/t5gemma-2-1b-1b | 25.5 | |
| Qwen3-8B-DMS-8x | medium | RULER 128K | qwen3-8b-base | nvidia | 109 | Qwen/Qwen3-8B | 25 |
Provenance & metadata (1)
source
- kind
- leaderboard-scrape
- paths
- benchmarks/ruler.html