Model
Mistral-Small-3.1-24B-Instruct-2503
mistral-small-3-1-24b-instruct-2503Record
- Family
- mistral
- Architecture
- dense
- Parameters
- 24
- HF downloads / 30d
- 2,900
Hugging Face model card
Identity
https://huggingface.co/mistralai/Devstral-Small-2505- Repository
- mistralai/Devstral-Small-2505
- Status
- known
- Link type
- Exact Hub repository
Public Hugging Face repository confirmed by the Hub API.
Leaderboard scores
Scraped public quality scores joined to this model by its Hugging Face repository. They describe the listed variant, not any specific local quantization, and are never speed measurements.
| Benchmark | Category | Score | Rank | Scored variant | Confidence |
|---|---|---|---|---|---|
| mt-bench | chat | 7.3 | 71 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| mt-bench | chat | 7.3 | 72 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| mt-bench | chat | 7.3 | 73 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| mt-bench | chat | 7.3 | 74 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| humaneval | coding | 88.41 | 23 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| humaneval | coding | 88.41 | 24 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| humaneval | coding | 88.41 | 25 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| humaneval | coding | 88.41 | 26 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| livecodebench | coding | 59.36 | 192 | Magistral-Small-2506 | low |
| livecodebench | coding | 59.36 | 194 | Magistral-Small-2506-GGUF | low |
| livecodebench | coding | 59.35 | 196 | Magistral-Small-2507 | low |
| mbpp | coding | 74.71 | 46 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| mbpp | coding | 74.71 | 47 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| mbpp | coding | 74.71 | 48 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| mbpp | coding | 74.71 | 49 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| mmlu | knowledge | 81.01 | 137 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| mmlu | knowledge | 81.01 | 139 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| mmlu | knowledge | 81.01 | 140 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| mmlu | knowledge | 81.01 | 141 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| mmlu | knowledge | 80.62 | 150 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| mmlu | knowledge | 80.62 | 152 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| mmlu | knowledge | 80.62 | 153 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| mmlu | knowledge | 80.62 | 154 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| mmlu-pro | knowledge | 66.76 | 268 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| mmlu-pro | knowledge | 66.76 | 270 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| mmlu-pro | knowledge | 66.76 | 271 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| mmlu-pro | knowledge | 66.76 | 272 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| mmlu-pro | knowledge | 56.03 | 334 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| mmlu-pro | knowledge | 56.03 | 336 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| mmlu-pro | knowledge | 56.03 | 337 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| mmlu-pro | knowledge | 56.03 | 338 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| simpleqa | knowledge | 10.43 | 56 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| simpleqa | knowledge | 10.43 | 58 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| simpleqa | knowledge | 10.43 | 59 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| simpleqa | knowledge | 10.43 | 60 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| triviaqa | knowledge | 80.5 | 12 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| triviaqa | knowledge | 80.5 | 14 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| triviaqa | knowledge | 80.5 | 15 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| triviaqa | knowledge | 80.5 | 16 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| longbench | long-context | 37.18 | 19 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| longbench | long-context | 37.18 | 20 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| longbench | long-context | 37.18 | 21 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| longbench | long-context | 37.18 | 22 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| ruler | long-context | 93.96 | 33 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| ruler | long-context | 93.96 | 34 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| ruler | long-context | 93.96 | 35 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| ruler | long-context | 93.96 | 36 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| ruler | long-context | 32 | 101 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | medium |
| ruler | long-context | 32 | 102 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | medium |
| ruler | long-context | 32 | 103 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | medium |
| ruler | long-context | 32 | 104 | Mistral-Small-3.1-24B-Instruct-2503 | medium |
| aime-2024 | math | 73.59 | 86 | Magistral-Small-2506 | low |
| aime-2024 | math | 73.59 | 88 | Magistral-Small-2506-GGUF | low |
| aime-2024 | math | 72.03 | 102 | Magistral-Small-2507 | low |
| aime-2025 | math | 64.95 | 166 | Magistral-Small-2506 | low |
| aime-2025 | math | 64.95 | 168 | Magistral-Small-2506-GGUF | low |
| aime-2025 | math | 60.99 | 178 | Magistral-Small-2507 | low |
| math | math | 69.3 | 275 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| math | math | 69.3 | 277 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| math | math | 69.3 | 278 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| math | math | 69.3 | 279 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| chartqa | multimodal | 86.24 | 16 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| chartqa | multimodal | 86.24 | 18 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| chartqa | multimodal | 86.24 | 19 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| chartqa | multimodal | 86.24 | 20 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| docvqa | multimodal | 94.08 | 27 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| docvqa | multimodal | 94.08 | 29 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| docvqa | multimodal | 94.08 | 30 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| docvqa | multimodal | 94.08 | 31 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| mathvista | multimodal | 68.91 | 28 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| mathvista | multimodal | 68.91 | 30 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| mathvista | multimodal | 68.91 | 31 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| mathvista | multimodal | 68.91 | 32 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| mmmu | multimodal | 64 | 123 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| mmmu | multimodal | 64 | 125 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| mmmu | multimodal | 64 | 126 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| mmmu | multimodal | 64 | 127 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| mmmu | multimodal | 59.27 | 135 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| mmmu | multimodal | 59.27 | 137 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| mmmu | multimodal | 59.27 | 138 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| mmmu | multimodal | 59.27 | 139 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| gpqa | reasoning | 44.42 | 160 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| gpqa | reasoning | 44.42 | 162 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| gpqa | reasoning | 44.42 | 163 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| gpqa | reasoning | 44.42 | 164 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| gpqa | reasoning | 37.5 | 191 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| gpqa | reasoning | 37.5 | 193 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| gpqa | reasoning | 37.5 | 194 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| gpqa | reasoning | 37.5 | 195 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| gpqa-diamond | reasoning | 71.46 | 139 | Magistral-Small-2507 | low |
| gpqa-diamond | reasoning | 70.83 | 144 | Magistral-Small-2506 | low |
| gpqa-diamond | reasoning | 70.83 | 146 | Magistral-Small-2506-GGUF | low |
| gpqa-diamond | reasoning | 45.96 | 284 | Mistral-Small-3.1-24B-Instruct-2503-GGUF | low |
| gpqa-diamond | reasoning | 45.96 | 286 | Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit | low |
| gpqa-diamond | reasoning | 45.96 | 287 | Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit | low |
| gpqa-diamond | reasoning | 45.96 | 288 | Mistral-Small-3.1-24B-Instruct-2503 | low |
| deepswe | swe | 42.2 | 6 | Devstral-Small-2507 | medium |
| deepswe | swe | 42.2 | 10 | Devstral-Small-2507 | medium |
| swebench-verified | swe | 53.6 | 42 | Devstral-Small-2507 | low |
| swebench-verified | swe | 53.6 | 45 | Devstral-Small-2507 | low |
| swebench-verified | swe | 46.8 | 50 | Devstral-Small-2505 | high |
| swebench-verified | swe | 46.8 | 51 | Devstral-Small-2505-GGUF | high |
| swebench-verified | swe | 46.8 | 52 | Devstral-Small-2505-unsloth-bnb-4bit | high |
| swebench-verified | swe | 46.8 | 53 | Devstral-Small-2505-GGUF | high |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- architecture
- dense
- family
- mistral
- id
- mistral-small-3-1-24b-instruct-2503
- name
- Mistral-Small-3.1-24B-Instruct-2503
- params
- 24
- schema version
- local-ai-registry/v1
downloads
- all time
- 831,886
- captured at
- 2026-08-31T12:36:33Z
- last 30d
- 2,900
Provenance & metadata (1)
source huggingface-api
Provenance & metadata (2)
facts
- active params · provenance · captured at
- 2026-08-30T09:10:02Z
active params · reason not-observed
active params · state unknown
provenance
- captured at
- 2026-08-30T09:10:02Z
sources
| captured at | kind | url |
|---|---|---|
| 2026-08-30T09:10:02Z | normalized-model | huggingface.co/mistralai/Devstral-Small-2505 ↗ |