Leaderboard
DeepSWE
deepsweRecord
- Category
- swe
- Scored models
- 17
Scores
| Model | Score |
|---|---|
| zai-org/GLM-5.2 | 46.2 |
| zai-org/GLM-5.2 | 46.2 |
| zai-org/GLM-5.2 | 46.2 |
| zai-org/GLM-5.2 | 46.2 |
| zai-org/GLM-5.2 | 46.2 |
| mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 42.2 |
| mistralai/Devstral-Small-2507 | 42.2 |
| allenai/SERA-32B | 42.2 |
| Qwen/Qwen3-32B | 42.2 |
| mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 42.2 |
| mistralai/Devstral-Small-2507 | 42.2 |
| allenai/SERA-8B | 42.2 |
| Qwen/Qwen3-14B | 42.2 |
| mistralai/Devstral-Small-2507 | 42.2 |
| poolside/Laguna-S-2.1 | 40.4 |
| poolside/Laguna-S-2.1 | 40.4 |
| nex-agi/Nex-N2-mini | 8 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- swe
- id
- deepswe
- name
- DeepSWE
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| GLM-5.2-FP8 | medium | DeepSWE | glm-5-2 | zai-org | 1 | zai-org/GLM-5.2 | 46.2 |
| GLM-5.2 | medium | DeepSWE | glm-5-2 | zai-org | 2 | zai-org/GLM-5.2 | 46.2 |
| GLM-5.2-GGUF | medium | DeepSWE | glm-5-2 | unsloth | 3 | zai-org/GLM-5.2 | 46.2 |
| GLM-5.2-FP8 | medium | DeepSWE | glm-5-2 | unsloth | 4 | zai-org/GLM-5.2 | 46.2 |
| GLM-5.2 | medium | DeepSWE | glm-5-2 | unsloth | 5 | zai-org/GLM-5.2 | 46.2 |
| Devstral-Small-2507 | medium | DeepSWE | mistral-small-3-1-24b-instruct-2503 | mistralai | 6 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 42.2 |
| Devstral-Small-2507-GGUF | medium | DeepSWE | devstral-small-2507 | unsloth | 7 | mistralai/Devstral-Small-2507 | 42.2 |
| SERA-32B | medium | DeepSWE | Unknown | allenai | 8 | allenai/SERA-32B | 42.2 |
| FrogBoss-32B-2510 | medium | DeepSWE‑32B‑Preview | qwen3-32b | microsoft | 9 | Qwen/Qwen3-32B | 42.2 |
| Devstral-Small-2507 | medium | DeepSWE | mistral-small-3-1-24b-instruct-2503 | unsloth | 10 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 | 42.2 |
| Devstral-Small-2507-bnb-4bit | medium | DeepSWE | devstral-small-2507 | unsloth | 11 | mistralai/Devstral-Small-2507 | 42.2 |
| SERA-8B | medium | DeepSWE | Unknown | allenai | 12 | allenai/SERA-8B | 42.2 |
| FrogMini-14B-2510 | medium | DeepSWE‑32B‑Preview | qwen3-14b | microsoft | 13 | Qwen/Qwen3-14B | 42.2 |
| Devstral-Small-2507-unsloth-bnb-4bit | medium | DeepSWE | devstral-small-2507 | unsloth | 14 | mistralai/Devstral-Small-2507 | 42.2 |
| Laguna-S-2.1-GGUF | low | Unknown | laguna-s-2-1 | unsloth | 15 | poolside/Laguna-S-2.1 | 40.4 |
| Laguna-S-2.1 | low | Unknown | laguna-s-2-1 | unsloth | 16 | poolside/Laguna-S-2.1 | 40.4 |
| Nex-N2-mini-GGUF | medium | DeepSWE | nex-n2-mini | Mungert | 17 | nex-agi/Nex-N2-mini | 8 |
Provenance & metadata (1)
source
- kind
- leaderboard-scrape
- paths
- benchmarks/deepswe.html