Local AI Registry

Leaderboard

BigCodeBench

bigcodebench
JSON APIBack to leaderboard search

Record

Category
coding
Scored models
17

Scores

ModelScore
deepseek-ai/DeepSeek-V4-Flash63.9
deepseek-ai/DeepSeek-V4-Pro63.9
—63.9
deepseek-ai/DeepSeek-V4-Flash63.9
deepseek-ai/DeepSeek-V4-Flash63.9
—63.9
deepseek-ai/DeepSeek-V4-Pro63.9
ByteDance-Seed/Seed-Coder-8B-Instruct53.3
ByteDance-Seed/Seed-Coder-8B-Instruct53.3
allenai/Olmo-3-1125-32B48.1
inclusionAI/LLaDA2.0-flash41.49
inclusionAI/LLaDA2.0-flash-preview40.7
inclusionAI/LLaDA2.0-mini36.05
inclusionAI/LLaDA2.0-mini-preview35
allenai/Olmo-3-1025-7B21.5
allenai/Olmo-Hybrid-7B21.5
allenai/Olmo-3-1025-7B21.5

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category
coding
id
bigcodebench
name
BigCodeBench
schema version
local-ai-registry/v1

rows

variantconfcontextmodel idorgrankrootscore
DeepSeek-V4-FlashmediumBigCodeBench (Pass@1)deepseek-v4-flashdeepseek-ai1deepseek-ai/DeepSeek-V4-Flash63.9
DeepSeek-V4-PromediumBigCodeBench (Pass@1)deepseek-v4-prodeepseek-ai2deepseek-ai/DeepSeek-V4-Pro63.9
DeepSeek-V4-Flash-DSparkmediumBigCodeBench (Pass@1)Unknowndeepseek-ai3—63.9
DeepSeek-V4-Flash-GGUFmediumBigCodeBench (Pass@1)deepseek-v4-flashunsloth4deepseek-ai/DeepSeek-V4-Flash63.9
DeepSeek-V4-FlashmediumBigCodeBench (Pass@1)deepseek-v4-flashunsloth5deepseek-ai/DeepSeek-V4-Flash63.9
DeepSeek-V4-Pro-DSparkmediumBigCodeBench (Pass@1)Unknowndeepseek-ai6—63.9
DeepSeek-V4-PromediumBigCodeBench (Pass@1)deepseek-v4-prounsloth7deepseek-ai/DeepSeek-V4-Pro63.9
Seed-Coder-8B-Instruct-GGUFhighUnknownseed-coder-8b-instructunsloth8ByteDance-Seed/Seed-Coder-8B-Instruct53.3
Seed-Coder-8B-Instruct-unsloth-bnb-4bithighUnknownseed-coder-8b-instructunsloth9ByteDance-Seed/Seed-Coder-8B-Instruct53.3
Olmo-3-1125-32BlowUnknownolmo-3-1125-32ballenai10allenai/Olmo-3-1125-32B48.1
LLaDA2.0-flashmediumBigcodebench-Fullllada2-0-flashinclusionAI11inclusionAI/LLaDA2.0-flash41.49
LLaDA2.0-flash-previewmediumBigcodebench-Fullllada2-0-flash-previewinclusionAI12inclusionAI/LLaDA2.0-flash-preview40.7
LLaDA2.0-minimediumBigCodeBench-Fullllada2-0-miniinclusionAI13inclusionAI/LLaDA2.0-mini36.05
LLaDA2.0-mini-previewmediumBigcodebench-Fullllada2-0-mini-previewinclusionAI14inclusionAI/LLaDA2.0-mini-preview35
Olmo-3-1025-7BlowUnknownolmo-3-1025-7ballenai15allenai/Olmo-3-1025-7B21.5
Olmo-Hybrid-7BlowUnknownolmo-hybrid-7ballenai16allenai/Olmo-Hybrid-7B21.5
Olmo-3-1025-7B-GGUFlowUnknownolmo-3-1025-7bMungert17allenai/Olmo-3-1025-7B21.5
Provenance & metadata (1)

source

kind
leaderboard-scrape
paths
benchmarks/bigcodebench.html