Leaderboard
IFBench
ifbenchRecord
- Category
- instruction-following
- Scored models
- 92
Scores
| Model | Score |
|---|---|
| nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 81.7 |
| nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 81.7 |
| nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 81.7 |
| nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 81.7 |
| google/gemma-4-26B-A4B-it | 77.77 |
| MiniMaxAI/MiniMax-M2.7 | 72.8 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.58 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.58 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.58 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.58 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.56 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.56 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.56 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.56 |
| MiniMaxAI/MiniMax-M2 | 72 |
| MiniMaxAI/MiniMax-M2 | 72 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 71.9 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 71.9 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 71.9 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 71.5 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 71.5 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 71.5 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 71.5 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | 71.5 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- instruction-following
- id
- ifbench
- name
- IFBench
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | medium | IFBench (prompt loose) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | nvidia | 1 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 81.7 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | medium | IFBench (prompt) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | nvidia | 2 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 81.7 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-GGUF | medium | IFBench (prompt loose) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | unsloth | 3 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 81.7 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | medium | IFBench (prompt loose) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | unsloth | 4 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 81.7 |
| Gemma-4-26B-A4B-NVFP4 | medium | IFBench | gemma-4-26b-a4b-it | nvidia | 5 | google/gemma-4-26B-A4B-it | 77.77 |
| MiniMax-M2.7-NVFP4 | high | Unknown | minimax-m2-7 | nvidia | 6 | MiniMaxAI/MiniMax-M2.7 | 72.8 |
| NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 | medium | IFBench (prompt) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 7 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.58 |
| NVIDIA-Nemotron-3-Super-120B-A12B-FP8 | medium | IFBench (prompt) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 8 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.58 |
| NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 | medium | IFBench (prompt) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 9 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.58 |
| NVIDIA-Nemotron-3-Super-120B-A12B-FP8 | medium | IFBench (prompt) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 10 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.58 |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | medium | IFBench (prompt) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 11 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.56 |
| NVIDIA-Nemotron-3-Super-120B-A12B-GGUF | medium | IFBench (prompt) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 12 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.56 |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16-GGUF | medium | IFBench (prompt) | nvidia-nemotron-3-super-120b-a12b-bf16 | Mungert | 13 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.56 |
| NVIDIA-Nemotron-3-Super-120B-A12B | medium | IFBench (prompt) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 14 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 72.56 |
| MiniMax-M2 | medium | IFBench | minimax-m2 | MiniMaxAI | 15 | MiniMaxAI/MiniMax-M2 | 72 |
| MiniMax-M2-GGUF | medium | IFBench | minimax-m2 | unsloth | 16 | MiniMaxAI/MiniMax-M2 | 72 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4 | medium | IFBench (prompt) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 17 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 71.9 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-FP8 | medium | IFBench (prompt) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 18 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 71.9 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16 | medium | IFBench (prompt) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 19 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 71.9 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | medium | IFBench (prompt) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 20 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 71.5 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | medium | IFBench (prompt) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 21 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 71.5 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 | medium | IFBench (prompt) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 22 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 71.5 |
| Nemotron-3-Nano-30B-A3B-GGUF | medium | IFBench (prompt) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 23 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 71.5 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | medium | IFBench (prompt) | nvidia-nemotron-3-nano-30b-a3b-nvfp4 | unsloth | 24 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | 71.5 |
| Nemotron-3-Nano-30B-A3B | medium | IFBench (prompt) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 25 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 71.5 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF | medium | IFBench (prompt) | nvidia-nemotron-3-nano-30b-a3b-bf16 | Mungert | 26 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 71.5 |
| Nemotron-3-Nano-30B-A3B-FP8 | medium | IFBench (prompt) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 27 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 71.5 |
| Qwen3.5-122B-A10B-NVFP4 | high | Unknown | qwen3-5-122b-a10b | nvidia | 28 | Qwen/Qwen3.5-122B-A10B | 70.8 |
| MiniMax-M2.5 | medium | IFBench | minimax-m2-5 | MiniMaxAI | 29 | MiniMaxAI/MiniMax-M2.5 | 70 |
| MiniMax-M2.5-GGUF | medium | IFBench | minimax-m2-5 | unsloth | 30 | MiniMaxAI/MiniMax-M2.5 | 70 |
| MiniMax-M2.1 | medium | IFBench | minimax-m2-1-reap-139b-a10b | MiniMaxAI | 31 | cerebras/MiniMax-M2.1-REAP-139B-A10B | 70 |
| MiniMax-M2.1-GGUF | medium | IFBench | minimax-m2-1 | unsloth | 32 | MiniMaxAI/MiniMax-M2.1 | 70 |
| MiniMax-M2.1 | medium | IFBench | minimax-m2-1 | unsloth | 33 | MiniMaxAI/MiniMax-M2.1 | 70 |
| Mistral-Medium-3.5-128B-NVFP4 | high | Unknown | mistral-medium-3-5-128b | nvidia | 34 | mistralai/Mistral-Medium-3.5-128B | 69.17 |
| Olmo-3.1-32B-Think | medium | IFBench | olmo-3-32b-think-dpo | allenai | 35 | allenai/Olmo-3-32B-Think-DPO | 68.1 |
| Olmo-3.1-32B-Think-GGUF | medium | IFBench | olmo-3-1-32b-think | unsloth | 36 | allenai/Olmo-3.1-32B-Think | 68.1 |
| NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-BF16 | medium | IFBench (instruct) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 37 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 67.39 |
| NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-NVFP4 | medium | IFBench (instruct) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 38 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 67.39 |
| NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-FP8 | medium | IFBench (instruct) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 39 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 67.39 |
| NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-BF16 | medium | IFBench (prompt) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 40 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 64.03 |
| NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-NVFP4 | medium | IFBench (prompt) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 41 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 64.03 |
| NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-FP8 | medium | IFBench (prompt) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 42 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 64.03 |
| LFM2.5-8B-A1B-GGUF | high | Unknown | lfm2-5-8b-a1b | unsloth | 43 | LiquidAI/LFM2.5-8B-A1B | 56.47 |
| LFM2.5-8B-A1B | high | Unknown | lfm2-5-8b-a1b | unsloth | 44 | LiquidAI/LFM2.5-8B-A1B | 56.47 |
| LFM2.5-8B-A1B-GGUF | high | Unknown | lfm2-5-8b-a1b-base | Mungert | 45 | LiquidAI/LFM2.5-8B-A1B-Base | 56.47 |
| LFM2.5-1.2B-Instruct-GGUF | low | Unknown | lfm2-5-1-2b-base | unsloth | 46 | LiquidAI/LFM2.5-1.2B-Instruct | 47.33 |
| LFM2.5-1.2B-Instruct | low | Unknown | lfm2-5-1-2b-base | unsloth | 47 | LiquidAI/LFM2.5-1.2B-Instruct | 47.33 |
| LFM2.5-1.2B-Thinking-GGUF | low | Unknown | lfm2-5-1-2b-thinking | unsloth | 48 | LiquidAI/LFM2.5-1.2B-Thinking | 47.33 |
| LFM2.5-1.2B-Instruct-GGUF | low | Unknown | lfm2-5-1-2b-base | Mungert | 49 | LiquidAI/LFM2.5-1.2B-Base | 47.33 |
| LFM2.5-1.2B-Thinking-GGUF | low | Unknown | lfm2-5-1-2b-base | Mungert | 50 | LiquidAI/LFM2.5-1.2B-Base | 47.33 |
| NVIDIA-Nemotron-3-Nano-4B-BF16 | medium | IFBench-Instruction | nvidia-nemotron-nano-12b-v2-base | nvidia | 51 | nvidia/NVIDIA-Nemotron-Nano-9B-v2 | 44.2 |
| NVIDIA-Nemotron-3-Nano-4B-FP8 | medium | IFBench-Instruction | nvidia-nemotron-nano-9b-v2 | nvidia | 52 | nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 | 44.2 |
| NVIDIA-Nemotron-3-Nano-4B-GGUF | medium | IFBench-Instruction | nvidia-nemotron-3-nano-4b-fp8 | nvidia | 53 | nvidia/NVIDIA-Nemotron-3-Nano-4B-FP8 | 44.2 |
| NVIDIA-Nemotron-3-Nano-4B | medium | IFBench-Instruction | nvidia-nemotron-nano-9b-v2 | unsloth | 54 | nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 | 44.2 |
| NVIDIA-Nemotron-3-Nano-4B-GGUF | medium | IFBench-Instruction | nvidia-nemotron-nano-9b-v2 | unsloth | 55 | nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 | 44.2 |
| NVIDIA-Nemotron-3-Nano-4B-FP8 | medium | IFBench-Instruction | nvidia-nemotron-nano-9b-v2 | unsloth | 56 | nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 | 44.2 |
| NVIDIA-Nemotron-3-Nano-4B-BF16 | medium | IFBench-Prompt | nvidia-nemotron-nano-12b-v2-base | nvidia | 57 | nvidia/NVIDIA-Nemotron-Nano-9B-v2 | 43.2 |
| NVIDIA-Nemotron-3-Nano-4B-FP8 | medium | IFBench-Prompt | nvidia-nemotron-nano-9b-v2 | nvidia | 58 | nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 | 43.2 |
| NVIDIA-Nemotron-3-Nano-4B-GGUF | medium | IFBench-Prompt | nvidia-nemotron-3-nano-4b-fp8 | nvidia | 59 | nvidia/NVIDIA-Nemotron-3-Nano-4B-FP8 | 43.2 |
| NVIDIA-Nemotron-3-Nano-4B | medium | IFBench-Prompt | nvidia-nemotron-nano-9b-v2 | unsloth | 60 | nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 | 43.2 |
| NVIDIA-Nemotron-3-Nano-4B-GGUF | medium | IFBench-Prompt | nvidia-nemotron-nano-9b-v2 | unsloth | 61 | nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 | 43.2 |
| NVIDIA-Nemotron-3-Nano-4B-FP8 | medium | IFBench-Prompt | nvidia-nemotron-nano-9b-v2 | unsloth | 62 | nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 | 43.2 |
| LFM2.5-230M | low | Unknown | lfm2-5-230m | unsloth | 63 | LiquidAI/LFM2.5-230M | 38.4 |
| LFM2.5-230M-GGUF | low | Unknown | lfm2-5-230m | unsloth | 64 | LiquidAI/LFM2.5-230M | 38.4 |
| Olmo-3-32B-Think | medium | IFBench | olmo-3-32b-think-dpo | allenai | 65 | allenai/Olmo-3-32B-Think-DPO | 37 |
| Olmo-3-32B-Think-SFT | medium | IFBench | olmo-3-1125-32b | allenai | 66 | allenai/Olmo-3-1125-32B | 37 |
| Olmo-3-32B-Think-GGUF | medium | IFBench | olmo-3-32b-think-dpo | unsloth | 67 | allenai/Olmo-3-32B-Think | 37 |
| Olmo-3-32B-Think-DPO | medium | IFBench | olmo-3-32b-think-sft | allenai | 68 | allenai/Olmo-3-32B-Think-SFT | 37 |
| Olmo-3-32B-Think-unsloth-bnb-4bit | medium | IFBench | olmo-3-32b-think-dpo | unsloth | 69 | allenai/Olmo-3-32B-Think | 37 |
| Nemotron-Cascade-8B | medium | IFBench | nemotron-cascade-8b | nvidia | 70 | nvidia/Nemotron-Cascade-8B | 34.4 |
| Nemotron-Cascade-8B-Thinking | medium | IFBench | nemotron-cascade-8b-thinking | nvidia | 71 | nvidia/Nemotron-Cascade-8B-Thinking | 34.4 |
| Nemotron-Cascade-14B-Thinking | medium | IFBench | nemotron-cascade-14b-thinking | nvidia | 72 | nvidia/Nemotron-Cascade-14B-Thinking | 33.7 |
| Olmo-3.1-32B-Instruct | medium | IFBench | olmo-3-1-32b-instruct-dpo | allenai | 73 | allenai/Olmo-3.1-32B-Instruct-DPO | 29.7 |
| Olmo-3.1-32B-Instruct-SFT | medium | IFBench | olmo-3-1125-32b | allenai | 74 | allenai/Olmo-3-1125-32B | 29.7 |
| Olmo-3.1-32B-Instruct-DPO | medium | IFBench | olmo-3-1-32b-instruct-sft | allenai | 75 | allenai/Olmo-3.1-32B-Instruct-SFT | 29.7 |
| Olmo-3.1-32B-Instruct-GGUF | medium | IFBench | olmo-3-1-32b-instruct | unsloth | 76 | allenai/Olmo-3.1-32B-Instruct | 29.7 |
| Olmo-3.1-32B-Instruct | medium | IFBench | olmo-3-1-32b-instruct | unsloth | 77 | allenai/Olmo-3.1-32B-Instruct | 29.7 |
| LFM2.5-8B-A1B-GGUF | medium | IFBench | lfm2-5-8b-a1b | unsloth | 78 | LiquidAI/LFM2.5-8B-A1B | 26 |
| LFM2.5-8B-A1B | medium | IFBench | lfm2-5-8b-a1b | unsloth | 79 | LiquidAI/LFM2.5-8B-A1B | 26 |
| LFM2.5-8B-A1B-GGUF | medium | IFBench | lfm2-5-8b-a1b-base | Mungert | 80 | LiquidAI/LFM2.5-8B-A1B-Base | 26 |
| LFM2-8B-A1B-GGUF | low | Unknown | lfm2-8b-a1b | unsloth | 81 | LiquidAI/LFM2-8B-A1B | 25.85 |
| LFM2-8B-A1B | low | Unknown | lfm2-8b-a1b | unsloth | 82 | LiquidAI/LFM2-8B-A1B | 25.85 |
| LFM2-2.6B-GGUF | high | Unknown | lfm2-2-6b | Mungert | 83 | LiquidAI/LFM2-2.6B | 22.19 |
| LFM2-1.2B-GGUF | high | Unknown | lfm2-1-2b | unsloth | 84 | LiquidAI/LFM2-1.2B | 20.7 |
| LFM2-1.2B-unsloth-bnb-4bit | high | Unknown | lfm2-1-2b | unsloth | 85 | LiquidAI/LFM2-1.2B | 20.7 |
| LFM2-1.2B | high | Unknown | lfm2-1-2b | unsloth | 86 | LiquidAI/LFM2-1.2B | 20.7 |
| LFM2-700M | high | Unknown | lfm2-700m | unsloth | 87 | LiquidAI/LFM2-700M | 20.56 |
| LFM2-700M-GGUF | high | Unknown | lfm2-700m | unsloth | 88 | LiquidAI/LFM2-700M | 20.56 |
| LFM2-350M | high | Unknown | lfm2-350m | unsloth | 89 | LiquidAI/LFM2-350M | 16.41 |
| LFM2-350M-GGUF | high | Unknown | lfm2-350m | unsloth | 90 | LiquidAI/LFM2-350M | 16.41 |
| LFM2-350M-unsloth-bnb-4bit | high | Unknown | lfm2-350m | unsloth | 91 | LiquidAI/LFM2-350M | 16.41 |
| AI21-Jamba-Reasoning-3B-GGUF | low | Unknown | Unknown | Mungert | 92 | ai21labs/AI21-Jamba-Reasoning-3B | 13 |
Provenance & metadata (1)
source
- kind
- leaderboard-scrape
- paths
- benchmarks/ifbench.html