Local AI Registry

Leaderboard

CMMLU

cmmlu
JSON APIBack to leaderboard search

Record

Category
knowledge
Scored models
45

Scores

ModelScore
deepseek-ai/DeepSeek-V4-Flash88.9
deepseek-ai/DeepSeek-V4-Pro88.9
—88.9
deepseek-ai/DeepSeek-V4-Flash88.9
deepseek-ai/DeepSeek-V4-Flash88.9
—88.9
deepseek-ai/DeepSeek-V4-Pro88.9
inclusionAI/LLaDA2.0-flash-preview86.59
inclusionAI/LLaDA2.0-flash86.36
Qwen/Qwen2-57B-A14B84.8
Qwen/Qwen2-72B84
01-ai/Yi-34B-200K83.6
larryvrh/Yi-34B-200K-Llamafied83.6
internlm/internlm2_5-20b82.22
inclusionAI/LLaDA2.0-mini-preview80.84
internlm/internlm2_5-20b-chat79.7
inclusionAI/LLaDA2.0-mini79.17
01-ai/Yi-34B-Chat79.11
01-ai/Yi-34B-Chat79.11
internlm/internlm2_5-7b79.1
SUSTech/SUS-Chat-34B78.68
internlm/internlm2_5-7b-chat78
01-ai/Yi-6B-200K75.5
01-ai/Yi-6B75.5

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category
knowledge
id
cmmlu
name
CMMLU
schema version
local-ai-registry/v1

rows

variantconfcontextmodel idorgrankrootscore
DeepSeek-V4-FlashmediumCMMLU (EM)deepseek-v4-flashdeepseek-ai1deepseek-ai/DeepSeek-V4-Flash88.9
DeepSeek-V4-PromediumCMMLU (EM)deepseek-v4-prodeepseek-ai2deepseek-ai/DeepSeek-V4-Pro88.9
DeepSeek-V4-Flash-DSparkmediumCMMLU (EM)Unknowndeepseek-ai3—88.9
DeepSeek-V4-Flash-GGUFmediumCMMLU (EM)deepseek-v4-flashunsloth4deepseek-ai/DeepSeek-V4-Flash88.9
DeepSeek-V4-FlashmediumCMMLU (EM)deepseek-v4-flashunsloth5deepseek-ai/DeepSeek-V4-Flash88.9
DeepSeek-V4-Pro-DSparkmediumCMMLU (EM)Unknowndeepseek-ai6—88.9
DeepSeek-V4-PromediumCMMLU (EM)deepseek-v4-prounsloth7deepseek-ai/DeepSeek-V4-Pro88.9
LLaDA2.0-flash-previewmediumCMMLUllada2-0-flash-previewinclusionAI8inclusionAI/LLaDA2.0-flash-preview86.59
LLaDA2.0-flashmediumCMMLUllada2-0-flashinclusionAI9inclusionAI/LLaDA2.0-flash86.36
Qwen2-57B-A14BmediumCMMLUqwen2-57b-a14bQwen10Qwen/Qwen2-57B-A14B84.8
Qwen2-72BmediumCMMLUqwen2-72bQwen11Qwen/Qwen2-72B84
Yi-34B-200K-GGUFhighUnknownyi-34b-200kTheBloke1201-ai/Yi-34B-200K83.6
Yi-34B-200K-Llamafied-GGUFhighUnknownyi-34b-200k-llamafiedTheBloke13larryvrh/Yi-34B-200K-Llamafied83.6
internlm2_5-20bmediumCMMLUinternlm2-5-20binternlm14internlm/internlm2_5-20b82.22
LLaDA2.0-mini-previewmediumCMMLUllada2-0-mini-previewinclusionAI15inclusionAI/LLaDA2.0-mini-preview80.84
internlm2_5-20b-chatmediumCMMLU (5-shot)internlm2-5-20b-chatinternlm16internlm/internlm2_5-20b-chat79.7
LLaDA2.0-minimediumCMMLUllada2-0-miniinclusionAI17inclusionAI/LLaDA2.0-mini79.17
Yi-34B-Chat-GGUFhighUnknownyi-34b-chatTheBloke1801-ai/Yi-34B-Chat79.11
Yi-34B-Chat-AWQhighUnknownyi-34b-chatTheBloke1901-ai/Yi-34B-Chat79.11
internlm2_5-7bmediumCMMLUinternlm2-5-7binternlm20internlm/internlm2_5-7b79.1
SUS-Chat-34B-GGUFhighUnknownUnknownTheBloke21SUSTech/SUS-Chat-34B78.68
internlm2_5-7b-chatmediumCMMLU (5-shot)internlm2-5-7b-chatinternlm22internlm/internlm2_5-7b-chat78
Yi-6B-200K-GGUFhighUnknownyi-6b-200kTheBloke2301-ai/Yi-6B-200K75.5
Yi-6B-GGUFhighUnknownyi-6bTheBloke2401-ai/Yi-6B75.5
OrionStar-Yi-34B-Chat-Llama-GGUFlowUnknownUnknownTheBloke25OrionStarAI/OrionStar-Yi-34B-Chat-Llama71
DeepSeek-V2-Chatmedium**CMMLU**deepseek-v2-chatdeepseek-ai26deepseek-ai/DeepSeek-V2-Chat69.3
DeepSeek-V2medium**CMMLU**deepseek-v2deepseek-ai27deepseek-ai/DeepSeek-V269.3
Nanbeige-16B-Base-GGUFhighUnknownUnknownTheBloke28Nanbeige/Nanbeige-16B-Base66.58
internlm2_5-1_8bmediumCMMLUUnknowninternlm29internlm/internlm2_5-1_8b65.44
internlm2_5-1_8b-chatmediumCMMLU (5-shot)internlm2-5-1-8b-chatinternlm30internlm/internlm2_5-1_8b-chat62.2
firefly-llama2-13B-chat-GGUFlowUnknownUnknownTheBloke31YeungNLP/firefly-llama2-13b-chat56.83
firefly-llama2-7B-chat-GGUFlowUnknownUnknownTheBloke32YeungNLP/firefly-llama2-7b-chat56.83
Llama3-70B-Chinese-Chat-GGUF-4bitlowUnknownUnknownshenzhi-wang33meta-llama/Meta-Llama-3-70B-Instruct55.51
Llama3-70B-Chinese-ChatlowUnknownUnknownshenzhi-wang34meta-llama/Meta-Llama-3-70B-Instruct55.51
Yi-34B-GGUFlowUnknownyi-34bTheBloke3501-ai/Yi-34B53.3
Qwen2-7BmediumCMMLUqwen2-7bQwen36Qwen/Qwen2-7B50.8
Skywork-13B-base-GGUFmedium**CMMLU**UnknownTheBloke37Skywork/Skywork-13B-base49.5
DeepSeek-V2-Lite-Chatmedium**CMMLU**deepseek-v2-lite-chatdeepseek-ai38deepseek-ai/DeepSeek-V2-Lite-Chat47.2
DeepSeek-V2-Litemedium**CMMLU**deepseek-v2-litedeepseek-ai39deepseek-ai/DeepSeek-V2-Lite47.2
Qwen-72BlowUnknownqwen-72bQwen40Qwen/Qwen-72B31.8
Qwen-7BlowUnknownqwen-7bQwen41Qwen/Qwen-7B31.8
Qwen-14BlowUnknownqwen-14bQwen42Qwen/Qwen-14B31.8
Skywork-13B-base-GGUFlowUnknownUnknownTheBloke43Skywork/Skywork-13B-base31.2
Qwen2-0.5BmediumCMMLUqwen2-0-5bQwen44Qwen/Qwen2-0.5B24.2
Qwen2-1.5BmediumCMMLUqwen2-1-5bQwen45Qwen/Qwen2-1.5B24.2
Provenance & metadata (1)

source

kind
leaderboard-scrape
paths
benchmarks/cmmlu.html