Leaderboard
LongBench
longbenchRecord
- Category
- long-context
- Scored models
- 25
Scores
| Model | Score |
|---|---|
| nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 61.9 |
| nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 61.9 |
| nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 61.9 |
| XiaomiMiMo/MiMo-V2-Flash | 60.6 |
| nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 | 46.1 |
| nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 | 46.1 |
| nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 | 46.1 |
| nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 | 46.1 |
| nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 | 46.1 |
| moonshotai/Kimi-VL-A3B-Instruct | 42.8 |
| deepseek-ai/DeepSeek-V4-Flash | 40.2 |
| deepseek-ai/DeepSeek-V4-Pro | 40.2 |
| — | 40.2 |
| deepseek-ai/DeepSeek-V4-Flash | 40.2 |
| deepseek-ai/DeepSeek-V4-Flash | 40.2 |
| — | 40.2 |
| deepseek-ai/DeepSeek-V4-Pro | 40.2 |
| mistralai/Mistral-Small-3.1-24B-Base-2503 | 37.18 |
| mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 37.18 |
| mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 37.18 |
| mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 37.18 |
| mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 37.18 |
| mistralai/Mistral-Small-3.1-24B-Base-2503 | 37.18 |
| inclusionAI/Ling-2.6-flash | 33.4 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- long-context
- id
- longbench
- name
- LongBench
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | medium | Longbench v2 (≤ 1M) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | nvidia | 1 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 61.9 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-GGUF | medium | Longbench v2 (≤ 1M) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | unsloth | 2 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 61.9 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | medium | Longbench v2 (≤ 1M) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | unsloth | 3 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 61.9 |
| MiMo-V2-Flash-GGUF | medium | LongBench V2 | mimo-v2-flash | unsloth | 4 | XiaomiMiMo/MiMo-V2-Flash | 60.6 |
| Nemotron-3-Nano-Omni-30B-A3B-Reasoning-NVFP4 | medium | MMlongBench Doc | nemotron-3-nano-omni-30b-a3b-reasoning-bf16 | nvidia | 5 | nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 | 46.1 |
| Nemotron-3-Nano-Omni-30B-A3B-Reasoning-FP8 | medium | MMlongBench Doc | nemotron-3-nano-omni-30b-a3b-reasoning-bf16 | nvidia | 6 | nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 | 46.1 |
| Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 | medium | MMlongBench Doc | nemotron-3-nano-omni-30b-a3b-reasoning-bf16 | nvidia | 7 | nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 | 46.1 |
| NVIDIA-Nemotron-3-Nano-Omni-30B-A3B-Reasoning-GGUF | medium | MMlongBench Doc | nemotron-3-nano-omni-30b-a3b-reasoning-bf16 | unsloth | 8 | nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 | 46.1 |
| NVIDIA-Nemotron-3-Nano-Omni-30B-A3B-Reasoning | medium | MMlongBench Doc | nemotron-3-nano-omni-30b-a3b-reasoning-bf16 | unsloth | 9 | nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 | 46.1 |
| Kimi-VL-A3B-Thinking-2506 | medium | MMLongBench-DOC (Acc) | kimi-vl-a3b-instruct | moonshotai | 10 | moonshotai/Kimi-VL-A3B-Instruct | 42.8 |
| DeepSeek-V4-Flash | medium | LongBench-V2 (EM) | deepseek-v4-flash | deepseek-ai | 11 | deepseek-ai/DeepSeek-V4-Flash | 40.2 |
| DeepSeek-V4-Pro | medium | LongBench-V2 (EM) | deepseek-v4-pro | deepseek-ai | 12 | deepseek-ai/DeepSeek-V4-Pro | 40.2 |
| DeepSeek-V4-Flash-DSpark | medium | LongBench-V2 (EM) | Unknown | deepseek-ai | 13 | — | 40.2 |
| DeepSeek-V4-Flash-GGUF | medium | LongBench-V2 (EM) | deepseek-v4-flash | unsloth | 14 | deepseek-ai/DeepSeek-V4-Flash | 40.2 |
| DeepSeek-V4-Flash | medium | LongBench-V2 (EM) | deepseek-v4-flash | unsloth | 15 | deepseek-ai/DeepSeek-V4-Flash | 40.2 |
| DeepSeek-V4-Pro-DSpark | medium | LongBench-V2 (EM) | Unknown | deepseek-ai | 16 | — | 40.2 |
| DeepSeek-V4-Pro | medium | LongBench-V2 (EM) | deepseek-v4-pro | unsloth | 17 | deepseek-ai/DeepSeek-V4-Pro | 40.2 |
| Mistral-Small-3.1-24B-Instruct-2503 | low | RULER 32K | RULER 128K | mistral-small-3-1-24b-base-2503 | mistralai | 18 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 37.18 |
| Mistral-Small-3.1-24B-Instruct-2503-GGUF | low | RULER 32K | RULER 128K | mistral-small-3-1-24b-instruct-2503 | unsloth | 19 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 37.18 |
| Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low | RULER 32K | RULER 128K | mistral-small-3-1-24b-instruct-2503 | unsloth | 20 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 37.18 |
| Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low | RULER 32K | RULER 128K | mistral-small-3-1-24b-instruct-2503 | unsloth | 21 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 37.18 |
| Mistral-Small-3.1-24B-Instruct-2503 | low | RULER 32K | RULER 128K | mistral-small-3-1-24b-instruct-2503 | unsloth | 22 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 37.18 |
| Mistral-Small-3.1-24B-Instruct-2503-GGUF | low | RULER 32K | RULER 128K | mistral-small-3-1-24b-base-2503 | Mungert | 23 | mistralai/Mistral-Small-3.1-24B-Base-2503 | 37.18 |
| Ling-2.6-flash-base | medium | LongBenchv2 | ling-2-6-flash | inclusionAI | 24 | inclusionAI/Ling-2.6-flash | 33.4 |
| Ling-2.6-1T-base | medium | LongBenchv2 | ling-2-6-1t | inclusionAI | 25 | inclusionAI/Ling-2.6-1T | 30.02 |
Provenance & metadata (1)
source
- kind
- leaderboard-scrape
- paths
- benchmarks/longbench.html