Local AI Registry

Leaderboard

SWE-bench Verified

swebench-verified
JSON APIBack to leaderboard search

Record

Category
swe
Scored models
61

Scores

ModelScore
zai-org/GLM-577.8
zai-org/GLM-577.8
zai-org/GLM-577.8
zai-org/GLM-577.8
nex-agi/Nex-N2-mini74.4
cerebras/MiniMax-M2.1-REAP-139B-A10B74
MiniMaxAI/MiniMax-M2.174
MiniMaxAI/MiniMax-M2.174
zai-org/GLM-4.773.8
zai-org/GLM-4.773.8
zai-org/GLM-4.773.8
XiaomiMiMo/MiMo-V2-Flash73.4
mistralai/Mistral-Small-3.1-24B-Base-250372.2
mistralai/Devstral-2-123B-Instruct-251272.2
mistralai/Devstral-Small-2-24B-Instruct-251272.2
mistralai/Devstral-2-123B-Instruct-251272.2
mistralai/Devstral-Small-2-24B-Instruct-251272.2
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF1671.9
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF1671.9
moonshotai/Kimi-K2-Thinking71.3
cerebras/MiniMax-M2.1-REAP-139B-A10B71.3
moonshotai/Kimi-K2-Thinking71.3
MiniMaxAI/MiniMax-M2.171.3
moonshotai/Kimi-K2-Thinking71.3

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category
swe
id
swebench-verified
name
SWE-bench Verified
schema version
local-ai-registry/v1

rows

variantconfcontextmodel idorgrankrootscore
GLM-5-FP8mediumSWE-bench Verifiedglm-5zai-org1zai-org/GLM-577.8
GLM-5mediumSWE-bench Verifiedglm-5zai-org2zai-org/GLM-577.8
GLM-5-FP8mediumSWE-bench Verifiedglm-5unsloth3zai-org/GLM-577.8
GLM-5-GGUFmediumSWE-bench Verifiedglm-5unsloth4zai-org/GLM-577.8
Nex-N2-mini-GGUFmediumSWE-Bench Verifiednex-n2-miniMungert5nex-agi/Nex-N2-mini74.4
MiniMax-M2.1mediumSWE-bench Verifiedminimax-m2-1-reap-139b-a10bMiniMaxAI6cerebras/MiniMax-M2.1-REAP-139B-A10B74
MiniMax-M2.1-GGUFmediumSWE-bench Verifiedminimax-m2-1unsloth7MiniMaxAI/MiniMax-M2.174
MiniMax-M2.1mediumSWE-bench Verifiedminimax-m2-1unsloth8MiniMaxAI/MiniMax-M2.174
GLM-4.7mediumSWE-bench Verifiedglm-4-7zai-org9zai-org/GLM-4.773.8
GLM-4.7-FP8mediumSWE-bench Verifiedglm-4-7zai-org10zai-org/GLM-4.773.8
GLM-4.7-GGUFmediumSWE-bench Verifiedglm-4-7unsloth11zai-org/GLM-4.773.8
MiMo-V2-Flash-GGUFmediumSWE-Bench Verifiedmimo-v2-flashunsloth12XiaomiMiMo/MiMo-V2-Flash73.4
Devstral-Small-2-24B-Instruct-2512lowUnknownmistral-small-3-1-24b-base-2503mistralai13mistralai/Mistral-Small-3.1-24B-Base-250372.2
Devstral-2-123B-Instruct-2512lowUnknownUnknownmistralai14mistralai/Devstral-2-123B-Instruct-251272.2
Devstral-Small-2-24B-Instruct-2512-GGUFlowUnknownUnknownunsloth15mistralai/Devstral-Small-2-24B-Instruct-251272.2
Devstral-2-123B-Instruct-2512-GGUFlowUnknownUnknownunsloth16mistralai/Devstral-2-123B-Instruct-251272.2
Devstral-Small-2-24B-Instruct-2512lowUnknownUnknownunsloth17mistralai/Devstral-Small-2-24B-Instruct-251272.2
NVIDIA-Nemotron-3-Ultra-550B-A55B-GGUFmediumSWE-Bench Verifiednvidia-nemotron-3-ultra-550b-a55b-bf16unsloth18nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF1671.9
NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4mediumSWE-Bench Verifiednvidia-nemotron-3-ultra-550b-a55b-bf16unsloth19nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF1671.9
Kimi-K2-Thinkingmedium**SWE-bench Verified**kimi-k2-thinkingmoonshotai20moonshotai/Kimi-K2-Thinking71.3
MiniMax-M2.1mediumSWE-bench Verified (Droid)minimax-m2-1-reap-139b-a10bMiniMaxAI21cerebras/MiniMax-M2.1-REAP-139B-A10B71.3
Kimi-K2-Thinking-GGUFmedium**SWE-bench Verified**kimi-k2-thinkingunsloth22moonshotai/Kimi-K2-Thinking71.3
MiniMax-M2.1-GGUFmediumSWE-bench Verified (Droid)minimax-m2-1unsloth23MiniMaxAI/MiniMax-M2.171.3
Kimi-K2-Thinkingmedium**SWE-bench Verified**kimi-k2-thinkingunsloth24moonshotai/Kimi-K2-Thinking71.3
MiniMax-M2.1mediumSWE-bench Verified (Droid)minimax-m2-1unsloth25MiniMaxAI/MiniMax-M2.171.3
NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16mediumSWE-Bench Verifiednvidia-nemotron-3-ultra-550b-a55b-bf16nvidia26nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF1670.7
NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4mediumSWE-Bench Verifiednvidia-nemotron-3-ultra-550b-a55b-bf16nvidia27nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF1670.7
MiniMax-M2medium**SWE-bench Verified**minimax-m2MiniMaxAI28MiniMaxAI/MiniMax-M269.4
MiniMax-M2-GGUFmedium**SWE-bench Verified**minimax-m2unsloth29MiniMaxAI/MiniMax-M269.4
MiniMax-M2.1mediumSWE-bench Verified (mini-swe-agent)minimax-m2-1-reap-139b-a10bMiniMaxAI30cerebras/MiniMax-M2.1-REAP-139B-A10B67
MiniMax-M2.1-GGUFmediumSWE-bench Verified (mini-swe-agent)minimax-m2-1unsloth31MiniMaxAI/MiniMax-M2.167
MiniMax-M2.1mediumSWE-bench Verified (mini-swe-agent)minimax-m2-1unsloth32MiniMaxAI/MiniMax-M2.167
Kimi-K2-Instruct-0905mediumSWE-Bench verifiedUnknownmoonshotai33moonshotai/Kimi-K2-Instruct65.8
Kimi-K2-Instruct-0905-GGUFmediumSWE-Bench verifiedUnknownunsloth34moonshotai/Kimi-K2-Instruct-090565.8
Youtu-LLM-2B-GGUFmediumSWE-Bench-Verifiedyoutu-llm-2b-baseMungert35tencent/Youtu-LLM-2B-Base60
GLM-4.7-FlashmediumSWE-bench Verifiedglm-4-7-flashzai-org36zai-org/GLM-4.7-Flash59.2
GLM-4.7-FlashmediumSWE-bench Verifiedglm-4-7-flashunsloth37zai-org/GLM-4.7-Flash59.2
GLM-4.7-Flash-FP8-DynamicmediumSWE-bench Verifiedglm-4-7-flashunsloth38zai-org/GLM-4.7-Flash59.2
GLM-4.7-Flash-GGUFmediumSWE-bench Verifiedglm-4-7-flashunsloth39zai-org/GLM-4.7-Flash59.2
GLM-4.7-Flash-NVFP4mediumSWE-bench Verifiedglm-4-7-flashunsloth40zai-org/GLM-4.7-Flash59.2
GLM-4.7-Flash-GGUFmediumSWE-bench Verifiedglm-4-7-flashMungert41zai-org/GLM-4.7-Flash59.2
Devstral-Small-2507lowUnknownmistral-small-3-1-24b-instruct-2503mistralai42mistralai/Mistral-Small-3.1-24B-Instruct-250353.6
cwmlowUnknownUnknownfacebook43facebook/cwm53.6
Devstral-Small-2507-GGUFlowUnknowndevstral-small-2507unsloth44mistralai/Devstral-Small-250753.6
Devstral-Small-2507lowUnknownmistral-small-3-1-24b-instruct-2503unsloth45mistralai/Mistral-Small-3.1-24B-Instruct-250353.6
Devstral-Small-2507-bnb-4bitlowUnknowndevstral-small-2507unsloth46mistralai/Devstral-Small-250753.6
cwm-pretrainlowUnknownUnknownfacebook47facebook/cwm-pretrain53.6
Devstral-Small-2507-unsloth-bnb-4bitlowUnknowndevstral-small-2507unsloth48mistralai/Devstral-Small-250753.6
LLaDA2.2-flashmediumSWE-bench VerifiedUnknowninclusionAI49inclusionAI/LLaDA2.2-flash49.28
Devstral-Small-2505highUnknownmistral-small-3-1-24b-instruct-2503mistralai50mistralai/Mistral-Small-3.1-24B-Instruct-250346.8
Devstral-Small-2505-GGUFhighUnknownmistral-small-3-1-24b-instruct-2503unsloth51mistralai/Devstral-Small-250546.8
Devstral-Small-2505-unsloth-bnb-4bithighUnknownmistral-small-3-1-24b-instruct-2503unsloth52mistralai/Devstral-Small-250546.8
Devstral-Small-2505-GGUFhighUnknownmistral-small-3-1-24b-instruct-2503Mungert53mistralai/Devstral-Small-250546.8
GLM-4-9B-0414lowUnknownglm-4-9b-0414zai-org54zai-org/GLM-4-9B-041433.8
GLM-4-32B-0414highUnknownglm-4-32b-0414zai-org55zai-org/GLM-4-32B-041433.8
GLM-4-9B-0414-GGUFlowUnknownglm-4-9b-0414unsloth56THUDM/GLM-4-9B-041433.8
GLM-4-32B-0414-GGUFhighUnknownUnknownunsloth57THUDM/GLM-4-32B-041433.8
GLM-4-32B-Base-0414lowUnknownglm-4-32b-base-0414zai-org58zai-org/GLM-4-32B-Base-041433.8
GLM-4-9B-0414-unsloth-bnb-4bitlowUnknownglm-4-9b-0414unsloth59THUDM/GLM-4-9B-041433.8
GLM-4-9B-0414lowUnknownglm-4-9b-0414unsloth60THUDM/GLM-4-9B-041433.8
GLM-4-9B-0414-bnb-4bitlowUnknownglm-4-9b-0414unsloth61THUDM/GLM-4-9B-041433.8
Provenance & metadata (1)

source

kind
leaderboard-scrape
paths
benchmarks/swebench-verified.html