Leaderboard
SciCode
scicodeRecord
- Category
- coding
- Scored models
- 47
Scores
| Model | Score |
|---|---|
| Qwen/Qwen2.5-32B | 100 |
| Qwen/Qwen2.5-1.5B | 100 |
| Qwen/Qwen2.5-14B | 100 |
| Qwen/Qwen2.5-7B | 100 |
| MiniMaxAI/MiniMax-M3 | 49.7 |
| MiniMaxAI/MiniMax-M2.7 | 48.7 |
| moonshotai/Kimi-K2-Thinking | 44.8 |
| moonshotai/Kimi-K2-Thinking | 44.8 |
| moonshotai/Kimi-K2-Thinking | 44.8 |
| nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 44.6 |
| nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 44.6 |
| nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 44.6 |
| nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 44.6 |
| MiniMaxAI/MiniMax-M2.5 | 44.4 |
| MiniMaxAI/MiniMax-M2.5 | 44.4 |
| mistralai/Mistral-Medium-3.5-128B | 42.6 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- coding
- id
- scicode
- name
- SciCode
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| OpenReasoning-Nemotron-32B | low | Unknown | qwen2-5-32b | nvidia | 1 | Qwen/Qwen2.5-32B | 100 |
| OpenReasoning-Nemotron-1.5B | low | Unknown | qwen2-5-1-5b | nvidia | 2 | Qwen/Qwen2.5-1.5B | 100 |
| OpenReasoning-Nemotron-14B | low | Unknown | qwen2-5-14b | nvidia | 3 | Qwen/Qwen2.5-14B | 100 |
| OpenReasoning-Nemotron-7B | low | Unknown | qwen2-5-7b | nvidia | 4 | Qwen/Qwen2.5-7B | 100 |
| MiniMax-M3-NVFP4 | high | Unknown | minimax-m3 | nvidia | 5 | MiniMaxAI/MiniMax-M3 | 49.7 |
| MiniMax-M2.7-NVFP4 | high | Unknown | minimax-m2-7 | nvidia | 6 | MiniMaxAI/MiniMax-M2.7 | 48.7 |
| Kimi-K2-Thinking | medium | **SciCode** | kimi-k2-thinking | moonshotai | 7 | moonshotai/Kimi-K2-Thinking | 44.8 |
| Kimi-K2-Thinking-GGUF | medium | **SciCode** | kimi-k2-thinking | unsloth | 8 | moonshotai/Kimi-K2-Thinking | 44.8 |
| Kimi-K2-Thinking | medium | **SciCode** | kimi-k2-thinking | unsloth | 9 | moonshotai/Kimi-K2-Thinking | 44.8 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | medium | SciCode (subtask) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | nvidia | 10 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 44.6 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | medium | SciCode (subtask) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | nvidia | 11 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 44.6 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-GGUF | medium | SciCode (subtask) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | unsloth | 12 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 44.6 |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | medium | SciCode (subtask) | nvidia-nemotron-3-ultra-550b-a55b-bf16 | unsloth | 13 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 44.6 |
| MiniMax-M2.5 | medium | SciCode | minimax-m2-5 | MiniMaxAI | 14 | MiniMaxAI/MiniMax-M2.5 | 44.4 |
| MiniMax-M2.5-GGUF | medium | SciCode | minimax-m2-5 | unsloth | 15 | MiniMaxAI/MiniMax-M2.5 | 44.4 |
| Mistral-Medium-3.5-128B-NVFP4 | high | Unknown | mistral-medium-3-5-128b | nvidia | 16 | mistralai/Mistral-Medium-3.5-128B | 42.6 |
| NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 | medium | SciCode (subtask) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 17 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | medium | SciCode (subtask) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 18 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| NVIDIA-Nemotron-3-Super-120B-A12B-FP8 | medium | SciCode (subtask) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 19 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| NVIDIA-Nemotron-3-Super-120B-A12B-GGUF | medium | SciCode (subtask) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 20 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 | medium | SciCode (subtask) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 21 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16-GGUF | medium | SciCode (subtask) | nvidia-nemotron-3-super-120b-a12b-bf16 | Mungert | 22 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| NVIDIA-Nemotron-3-Super-120B-A12B | medium | SciCode (subtask) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 23 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| NVIDIA-Nemotron-3-Super-120B-A12B-FP8 | medium | SciCode (subtask) | nvidia-nemotron-3-super-120b-a12b-bf16 | unsloth | 24 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 42.05 |
| Qwen3.5-122B-A10B-NVFP4 | high | Unknown | qwen3-5-122b-a10b | nvidia | 25 | Qwen/Qwen3.5-122B-A10B | 41.79 |
| MiniMax-M2.1 | medium | SciCode | minimax-m2-1-reap-139b-a10b | MiniMaxAI | 26 | cerebras/MiniMax-M2.1-REAP-139B-A10B | 41 |
| MiniMax-M2.1-GGUF | medium | SciCode | minimax-m2-1 | unsloth | 27 | MiniMaxAI/MiniMax-M2.1 | 41 |
| MiniMax-M2.1 | medium | SciCode | minimax-m2-1 | unsloth | 28 | MiniMaxAI/MiniMax-M2.1 | 41 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4 | medium | SciCode (subtask) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 29 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 40.6 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-FP8 | medium | SciCode (subtask) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 30 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 40.6 |
| NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16 | medium | SciCode (subtask) | nvidia-nemotron-3-super-120b-a12b-bf16 | nvidia | 31 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 40.6 |
| MiniMax-M2 | medium | SciCode | minimax-m2 | MiniMaxAI | 32 | MiniMaxAI/MiniMax-M2 | 36 |
| MiniMax-M2-GGUF | medium | SciCode | minimax-m2 | unsloth | 33 | MiniMaxAI/MiniMax-M2 | 36 |
| Gemma-4-31B-IT-NVFP4 | medium | Scicode subtask acc (pass@1) | gemma-4-31b-it | nvidia | 34 | google/gemma-4-31B-it | 33.61 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | medium | SciCode (subtask) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 35 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 33.3 |
| Nemotron-3-Nano-30B-A3B-GGUF | medium | SciCode (subtask) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 36 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 33.3 |
| Nemotron-3-Nano-30B-A3B | medium | SciCode (subtask) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 37 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 33.3 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF | medium | SciCode (subtask) | nvidia-nemotron-3-nano-30b-a3b-bf16 | Mungert | 38 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 33.3 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | medium | SciCode (subtask) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 39 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 33 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 | medium | SciCode (subtask) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 40 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 33 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | medium | SciCode (subtask) | nvidia-nemotron-3-nano-30b-a3b-nvfp4 | unsloth | 41 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | 33 |
| Nemotron-3-Nano-30B-A3B-FP8 | medium | SciCode (subtask) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 42 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 33 |
| OpenReasoning-Nemotron-32B-GGUF | low | Unknown | qwen2-5-32b | unsloth | 43 | nvidia/OpenReasoning-Nemotron-32B | 2.2 |
| OpenReasoning-Nemotron-7B-GGUF | low | Unknown | qwen2-5-7b-instruct | Mungert | 44 | Qwen/Qwen2.5-7B-Instruct | 2.2 |
| OpenReasoning-Nemotron-1.5B-GGUF | low | Unknown | qwen2-5-1-5b-instruct | Mungert | 45 | Qwen/Qwen2.5-1.5B-Instruct | 2.2 |
| OpenReasoning-Nemotron-14B-GGUF | low | Unknown | qwen2-5-14b | Mungert | 46 | Qwen/Qwen2.5-14B-Instruct | 2.2 |
| OpenReasoning-Nemotron-32B-GGUF | low | Unknown | qwen2-5-32b-instruct | Mungert | 47 | Qwen/Qwen2.5-32B-Instruct | 2.2 |
Provenance & metadata (1)
source
- kind
- leaderboard-scrape
- paths
- benchmarks/scicode.html