Local AI Registry

Leaderboard

GSM8K

gsm8k
JSON APIBack to leaderboard search

Record

Category
math
Scored models
437

Scores

ModelScore
inclusionAI/LLaDA2.0-flash96.36
nvidia/AceMath-7B-RM96.22
nvidia/AceMath-72B-RM96.22
MiniMaxAI/MiniMax-Text-01-hf95.6
MiniMaxAI/MiniMax-Text-0195.6
inclusionAI/LLaDA2.0-flash-preview95.45
inclusionAI/LLaDA2.0-mini-preview94.62
google/diffusiongemma-26B-A4B-it94.54
nvidia/Nemotron-H-56B-Base-8K93.71
inclusionAI/LLaDA2.0-mini93.63
nvidia/Nemotron-H-56B-Base-8K93.3
Qwen/Qwen2-72B93
mistralai/Mistral-Large-Instruct-240793
tencent/Hunyuan-A13B-Instruct92.8
nvidia/AceMath-RL-Nemotron-7B92.7
nvidia/AceMath-RL-Nemotron-7B92.7
nvidia/Nemotron-Labs-TwoTower-30B-A3B-Base-BF1692.49
llm-agents/tora-code-34b-v1.092
llm-agents/tora-code-13b-v1.092
llm-agents/tora-7b-v1.092
llm-agents/tora-13b-v1.092
llm-agents/tora-70b-v1.092
llm-agents/tora-code-7b-v1.092
internlm/internlm2-math-plus-mixtral8x22b91.8

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category
math
id
gsm8k
name
GSM8K
schema version
local-ai-registry/v1

rows

variantconfcontextmodel idorgrankrootscore
LLaDA2.0-flashmediumGSM8Kllada2-0-flashinclusionAI1inclusionAI/LLaDA2.0-flash96.36
AceMath-7B-RMlowGSM8Kacemath-7b-rmnvidia2nvidia/AceMath-7B-RM96.22
AceMath-72B-RMlowGSM8Kacemath-72b-rmnvidia3nvidia/AceMath-72B-RM96.22
MiniMax-Text-01-hfmediumGSM8k<sup>*</sup>minimax-text-01-hfMiniMaxAI4MiniMaxAI/MiniMax-Text-01-hf95.6
MiniMax-Text-01mediumGSM8k<sup>*</sup>minimax-text-01MiniMaxAI5MiniMaxAI/MiniMax-Text-0195.6
LLaDA2.0-flash-previewmediumGSM8Kllada2-0-flash-previewinclusionAI6inclusionAI/LLaDA2.0-flash-preview95.45
LLaDA2.0-mini-previewmediumGSM8Kllada2-0-mini-previewinclusionAI7inclusionAI/LLaDA2.0-mini-preview94.62
diffusiongemma-26B-A4B-it-NVFP4mediumGSM8Kdiffusiongemma-26b-a4bnvidia8google/diffusiongemma-26B-A4B-it94.54
Nemotron-H-56B-Base-8KlowGSM8K 8-shot CoT | MATH 4-shot CoT | MATH-Lvl 5 4-shot CoT | MATH-500 4-shot CoTnemotron-h-56b-base-8knvidia9nvidia/Nemotron-H-56B-Base-8K93.71
LLaDA2.0-minimediumGSM8Kllada2-0-miniinclusionAI10inclusionAI/LLaDA2.0-mini93.63
Nemotron-H-47B-Base-8KlowGSM8K 8-shot CoT | MATH 4-shot CoT | MATH-Lvl 5 4-shot CoT | MATH-500 4-shot CoTnemotron-h-56b-base-8knvidia11nvidia/Nemotron-H-56B-Base-8K93.3
Qwen2-72B-InstructmediumGSM8Kqwen2-72bQwen12Qwen/Qwen2-72B93
Mistral-Large-Instruct-2407mediumGSM8Kmistral-large-instruct-2407mistralai13mistralai/Mistral-Large-Instruct-240793
Hunyuan-A13B-Instruct-GGUFmediumGSM8khunyuan-a13b-instructunsloth14tencent/Hunyuan-A13B-Instruct92.8
AceMath-RL-Nemotron-7Blow**GSM8K<br>(AVG@1)**acemath-rl-nemotron-7bnvidia15nvidia/AceMath-RL-Nemotron-7B92.7
AceMath-RL-Nemotron-7B-GGUFlow**GSM8K<br>(AVG@1)**acemath-rl-nemotron-7bMungert16nvidia/AceMath-RL-Nemotron-7B92.7
Nemotron-Labs-TwoTower-30B-A3B-Base-BF16mediumGSM8K (8-shot, acc)nemotron-labs-twotower-30b-a3b-base-bf16nvidia17nvidia/Nemotron-Labs-TwoTower-30B-A3B-Base-BF1692.49
tora-code-34b-v1.0-GGUFlowGSM8kUnknownTheBloke18llm-agents/tora-code-34b-v1.092
tora-code-13B-v1.0-GGUFlowGSM8kUnknownTheBloke19llm-agents/tora-code-13b-v1.092
tora-7B-v1.0-GGUFlowGSM8kUnknownTheBloke20llm-agents/tora-7b-v1.092
tora-13B-v1.0-GGUFlowGSM8kUnknownTheBloke21llm-agents/tora-13b-v1.092
tora-70B-v1.0-GGUFlowGSM8kUnknownTheBloke22llm-agents/tora-70b-v1.092
tora-code-7B-v1.0-GGUFlowGSM8kUnknownTheBloke23llm-agents/tora-code-7b-v1.092
internlm2-math-plus-mixtral8x22bhighGSM8Kinternlm2-math-plus-mixtral8x22binternlm24internlm/internlm2-math-plus-mixtral8x22b91.8
NVIDIA-Nemotron-Nano-9B-v2-BasemediumGSM8K CoTnvidia-nemotron-nano-9b-v2-basenvidia25nvidia/NVIDIA-Nemotron-Nano-9B-v2-Base91.66
NVIDIA-Nemotron-Nano-12B-v2-BasemediumGSM8K CoTnvidia-nemotron-nano-12b-v2-basenvidia26nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base91.66
DeepSeek-V4-FlashmediumGSM8K (EM)deepseek-v4-flashdeepseek-ai27deepseek-ai/DeepSeek-V4-Flash91.1
DeepSeek-V4-PromediumGSM8K (EM)deepseek-v4-prodeepseek-ai28deepseek-ai/DeepSeek-V4-Pro91.1
DeepSeek-V4-Flash-DSparkmediumGSM8K (EM)deepseek-v4-flashdeepseek-ai29deepseek-ai/DeepSeek-V4-Flash91.1
DeepSeek-V4-Flash-GGUFmediumGSM8K (EM)deepseek-v4-flashunsloth30deepseek-ai/DeepSeek-V4-Flash91.1
DeepSeek-V4-FlashmediumGSM8K (EM)deepseek-v4-flashunsloth31deepseek-ai/DeepSeek-V4-Flash91.1
DeepSeek-V4-Pro-DSparkmediumGSM8K (EM)Unknowndeepseek-ai32—91.1
DeepSeek-V4-PromediumGSM8K (EM)deepseek-v4-prounsloth33deepseek-ai/DeepSeek-V4-Pro91.1
Phi-3-medium-4k-instructmediumGSM8K Chain of Thought&lt;br&gt;8-shotphi-3-medium-4k-instructmicrosoft34microsoft/Phi-3-medium-4k-instruct91
NVLM-D-72BlowGSM8Knvlm-d-72bnvidia35nvidia/NVLM-D-72B90.8
NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16mediumGSM8Knvidia-nemotron-3-super-120b-a12b-base-bf16nvidia36nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF1690.67
Ling-2.6-flash-basemediumGSM8Kling-2-6-flashinclusionAI37inclusionAI/Ling-2.6-flash90.6
Phi-3-small-8k-instructmediumGSM8K Chain of Thought&lt;br&gt;8-shotphi-3-small-8k-instructmicrosoft38microsoft/Phi-3-small-8k-instruct89.6
Ling-2.6-1T-basemediumGSM8Kling-2-6-1tinclusionAI39inclusionAI/Ling-2.6-1T89.31
NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16mediumGSM8K (8-shot, acc)nvidia-nemotron-3-nano-30b-a3b-base-bf16nvidia40nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF1689.01
Nemotron-H-4B-Instruct-128KlowGSM8K 0-shotnemotron-h-4b-base-8knvidia41nvidia/Nemotron-H-4B-Base-8K88.93
Qwen2.5-Omni-3BmediumGSM8Kqwen2-5-omni-3bQwen42Qwen/Qwen2.5-Omni-3B88.7
Qwen2.5-Omni-7BmediumGSM8Kqwen2-5-omni-7bQwen43Qwen/Qwen2.5-Omni-7B88.7
Qwen2.5-Omni-7B-GGUFmediumGSM8Kqwen2-5-omni-7bunsloth44Qwen/Qwen2.5-Omni-7B88.7
Qwen2.5-Omni-3B-GGUFmediumGSM8Kqwen2-5-omni-3bunsloth45Qwen/Qwen2.5-Omni-3B88.7
Qwen2.5-Omni-3B-GGUFmediumGSM8Kqwen2-5-omni-3bMungert46Qwen/Qwen2.5-Omni-3B88.7
Qwen2.5-Omni-7BmediumGSM8Kqwen2-5-omni-7bunsloth47Qwen/Qwen2.5-Omni-7B88.7
Qwen2.5-Omni-7B-GGUFmediumGSM8Kqwen2-5-omni-7bMungert48Qwen/Qwen2.5-Omni-7B88.7
Qwen2.5-Omni-3BmediumGSM8Kqwen2-5-omni-3bunsloth49Qwen/Qwen2.5-Omni-3B88.7
Phi-4-mini-instructmediumGSM8K (8-shot, CoT)phi-4-mini-instructmicrosoft50microsoft/Phi-4-mini-instruct88.6
Phi-4-mini-instruct-GGUFmediumGSM8K (8-shot, CoT)phi-4-mini-instructunsloth51microsoft/Phi-4-mini-instruct88.6
Phi-4-mini-instruct-unsloth-bnb-4bitmediumGSM8K (8-shot, CoT)phi-4-mini-instructunsloth52microsoft/Phi-4-mini-instruct88.6
Phi-4-mini-instruct-bnb-4bitmediumGSM8K (8-shot, CoT)phi-4-mini-instructunsloth53microsoft/Phi-4-mini-instruct88.6
Phi-4-mini-instructmediumGSM8K (8-shot, CoT)phi-4-mini-instructunsloth54microsoft/Phi-4-mini-instruct88.6
Phi-4-mini-instruct-GGUFmediumGSM8K (8-shot, CoT)phi-4-mini-instructMungert55microsoft/Phi-4-mini-instruct88.6
NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16mediumGSM8Knvidia-nemotron-3-ultra-550b-a55b-base-bf16nvidia56nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF1688.1
internlm2-math-plus-20bhighGSM8Kinternlm2-math-plus-20binternlm57internlm/internlm2-math-plus-20b87.7
Phi-3-medium-128k-instructmediumGSM8K Chain of Thought&lt;br&gt;8-shotphi-3-medium-128k-instructmicrosoft58microsoft/Phi-3-medium-128k-instruct87.5
Phi-3-small-128k-instructmediumGSM8K Chain of Thought&lt;br&gt;8-shotphi-3-small-128k-instructmicrosoft59microsoft/Phi-3-small-128k-instruct87.3
Nemotron-H-8B-Base-8KlowGSM8K 8-shot CoT | MATH 4-shot CoT | MATH-Lvl 5 4-shot CoT | MATH-500 4-shot CoTnemotron-h-8b-base-8knvidia60nvidia/Nemotron-H-8B-Base-8K87.11
internlm2_5-7b-chatmediumGSM8K (0-shot CoT)internlm2-5-7b-chatinternlm61internlm/internlm2_5-7b-chat86
internlm2-math-plus-7bhighGSM8Kinternlm2-math-plus-7binternlm62internlm/internlm2-math-plus-7b85.8
Phi-mini-MoE-instructhighGSM8Kphi-mini-moe-instructmicrosoft63microsoft/Phi-mini-MoE-instruct84.89
Falcon-H1-3B-InstructmediumGSM8kfalcon-h1-3b-basetiiuae64tiiuae/Falcon-H1-3B-Base84.76
Falcon-H1-3B-Instruct-GGUFmediumGSM8kfalcon-h1-3b-basetiiuae65tiiuae/Falcon-H1-3B-Base84.76
Falcon-H1-3B-Instruct-GGUFmediumGSM8kfalcon-h1-3b-instructunsloth66tiiuae/Falcon-H1-3B-Instruct84.76
OpenMath2-Llama3.1-8BlowGSM8Kllama-3-1-8bnvidia67meta-llama/Llama-3.1-8B84.5
OpenMath2-Llama3.1-8B-GGUFlowGSM8Kllama-3-1-8bMungert68meta-llama/Llama-3.1-8B84.5
OpenMath2-Llama3.1-70BlowGSM8Kllama-3-1-70bnvidia69meta-llama/Llama-3.1-70B84.5
LFM2-8B-A1B-GGUFlowGSM8Klfm2-8b-a1bunsloth70LiquidAI/LFM2-8B-A1B84.38
LFM2-8B-A1BlowGSM8Klfm2-8b-a1bunsloth71LiquidAI/LFM2-8B-A1B84.38
glm-4-9bhighGSM8Kglm-4-9bzai-org72zai-org/glm-4-9b84
glm-4-9b-hfhighGSM8Kglm-4-9b-hfzai-org73zai-org/glm-4-9b-hf84
Falcon-H1-34B-InstructmediumGSM8kfalcon-h1-34b-basetiiuae74tiiuae/Falcon-H1-34B-Base83.62
Falcon-H1-34B-Instruct-GGUFmediumGSM8kfalcon-h1-34b-instructtiiuae75tiiuae/Falcon-H1-34B-Instruct83.62
Falcon-H1-34B-Instruct-GGUFmediumGSM8kfalcon-h1-34b-instructunsloth76tiiuae/Falcon-H1-34B-Instruct83.62
Falcon-H1-34B-Instruct-GPTQ-Int4mediumGSM8kfalcon-h1-34b-instructtiiuae77tiiuae/Falcon-H1-34B-Instruct83.62
WizardMath-7B-V1.1-GGUFlowGSM8kUnknownTheBloke78WizardLM/WizardMath-7B-V1.183.2
DeepSeek-V2-Chatmedium**GSM8K**deepseek-v2-chatdeepseek-ai79deepseek-ai/DeepSeek-V2-Chat83
DeepSeek-V2medium**GSM8K**deepseek-v2deepseek-ai80deepseek-ai/DeepSeek-V283
LFM2-2.6B-GGUFhighGSM8Klfm2-2-6bMungert81LiquidAI/LFM2-2.6B82.41
Falcon-H1-1.5B-Deep-InstructmediumGSM8kfalcon-h1-1-5b-deep-basetiiuae82tiiuae/Falcon-H1-1.5B-Deep-Base82.34
Falcon-H1-1.5B-Deep-Instruct-GGUFmediumGSM8kfalcon-h1-1-5b-deep-instructtiiuae83tiiuae/Falcon-H1-1.5B-Deep-Instruct82.34
Falcon-H1-1.5B-Deep-Instruct-GGUFmediumGSM8kfalcon-h1-1-5b-deep-instructunsloth84tiiuae/Falcon-H1-1.5B-Deep-Instruct82.34
Falcon-H1-1.5B-Deep-InstructmediumGSM8kfalcon-h1-1-5b-deep-instructunsloth85tiiuae/Falcon-H1-1.5B-Deep-Instruct82.34
Falcon-H1-1.5B-Deep-Instruct-GPTQ-Int4mediumGSM8kfalcon-h1-1-5b-deep-instructtiiuae86tiiuae/Falcon-H1-1.5B-Deep-Instruct82.34
Falcon-H1-7B-InstructmediumGSM8kfalcon-h1-7b-basetiiuae87tiiuae/Falcon-H1-7B-Base81.65
Falcon-H1-7B-Instruct-GPTQ-Int4mediumGSM8kfalcon-h1-7b-instructtiiuae88tiiuae/Falcon-H1-7B-Instruct81.65
Falcon-H1-7B-Instruct-GGUFmediumGSM8kfalcon-h1-7b-instructtiiuae89tiiuae/Falcon-H1-7B-Instruct81.65
Falcon-H1-7B-Instruct-GGUFmediumGSM8kfalcon-h1-7b-instructunsloth90tiiuae/Falcon-H1-7B-Instruct81.65
WizardCoder-Python-34B-V1.0-GGUFlowGSM8kUnknownTheBloke91WizardLM/WizardCoder-Python-34B-V1.081.6
WizardCoder-Python-13B-V1.0-GGUFlowGSM8kUnknownTheBloke92WizardLM/WizardCoder-Python-13B-V1.081.6
WizardCoder-Python-7B-V1.0-GGUFlowGSM8kUnknownTheBloke93WizardLM/WizardCoder-Python-7b-V1.081.6
WizardLM-70B-V1.0-GPTQlowGSM8kUnknownTheBloke94WizardLM/WizardLM-70B-V1.081.6
WizardLM-13B-V1.2-GGUFlowGSM8kUnknownTheBloke95WizardLM/WizardLM-13B-V1.281.6
WizardLM-70B-V1.0-GGUFlowGSM8kUnknownTheBloke96WizardLM/WizardLM-70B-V1.081.6
WizardLM-13B-V1.1-GGUFlowGSM8kUnknownTheBloke97WizardLM/WizardLM-13B-V1.181.6
wizardLM-7B-GGUFlowGSM8kUnknownTheBloke98WizardLM/WizardLM-7B-V1.081.6
WizardMath-70B-V1.0-GGUFhighGSM8kUnknownTheBloke99WizardLM/WizardMath-70B-V1.081.6
WizardLM-30B-GGUFlowGSM8kUnknownTheBloke100WizardLM/WizardLM-30B-V1.081.6
WizardCoder-Python-13B-V1.0-GPTQlowGSM8kUnknownTheBloke101WizardLM/WizardCoder-Python-13B-V1.081.6
WizardLM-13B-V1.2-GPTQlowGSM8kUnknownTheBloke102WizardLM/WizardLM-13B-V1.281.6
WizardLM-13B-V1.1-GPTQlowGSM8kUnknownTheBloke103WizardLM/WizardLM-13B-V1.181.6
WizardCoder-Python-34B-V1.0-GPTQlowGSM8kUnknownTheBloke104WizardLM/WizardCoder-Python-34B-V1.081.6
Mistral-Small-24B-Base-2501medium[GSM8K][]mistral-small-24b-base-2501mistralai105mistralai/Mistral-Small-24B-Base-250180.73
SUS-Chat-34B-GGUFhighgsm8kUnknownTheBloke106SUSTech/SUS-Chat-34B80.06
OLMo-2-1124-7B-InstructlowGSM8kUnknownallenai107allenai/OLMo-2-1124-7B-DPO79.7
OLMo-2-1124-13B-InstructlowGSM8kolmo-2-1124-13b-instruct-rlvr2allenai108allenai/OLMo-2-1124-13B-Instruct-RLVR279.7
OLMo-2-1124-7B-SFTlowGSM8kolmo2-7b-1124allenai109allenai/OLMo2-7B-112479.7
OLMo-2-1124-7B-DPOlowGSM8kUnknownallenai110allenai/OLMo-2-1124-7B-SFT79.7
OLMo-2-1124-13B-SFTlowGSM8kolmo2-13b-1124allenai111allenai/OLMo2-13B-112479.7
OLMo-2-1124-13B-DPOlowGSM8kUnknownallenai112allenai/OLMo-2-1124-13B-SFT79.7
OLMo-2-1124-7B-Instruct-previewlowGSM8kUnknownallenai113allenai/OLMo-2-1124-7B-DPO79.7
OLMo-2-1124-7B-RMlowGSM8kUnknownallenai114allenai/OLMo-2-1124-7B-SFT79.7
OLMo-2-1124-7B-RM-PreviewlowGSM8kUnknownallenai115allenai/OLMo-2-1124-7B-SFT79.7
OLMo-2-1124-13B-RMlowGSM8kUnknownallenai116allenai/OLMo-2-1124-13B-SFT79.7
OLMo-2-1124-13B-Instruct-previewlowGSM8kolmo-2-1124-13b-dpoallenai117allenai/OLMo-2-1124-13B-DPO79.7
OLMo-2-1124-7B-SFT-PreviewlowGSM8kolmo2-7b-1124allenai118allenai/OLMo2-7B-112479.7
OLMo-2-1124-7B-DPO-PreviewlowGSM8kUnknownallenai119allenai/OLMo-2-1124-7B-SFT79.7
Qwen2-7B-InstructmediumGSM8Kqwen2-7bQwen120Qwen/Qwen2-7B79.6
glm-4-9b-chathighGSM8Kglm-4-9b-chatzai-org121zai-org/glm-4-9b-chat79.6
glm-4-9b-chat-hfhighGSM8Kglm-4-9b-chatzai-org122THUDM/glm-4-9b-chat79.6
Qwen2-72BmediumGSM8Kqwen2-72bQwen123Qwen/Qwen2-72B79.2
Phi-tiny-MoE-instructhighGSM8Kphi-tiny-moe-instructmicrosoft124microsoft/Phi-tiny-MoE-instruct78.47
openchat-3.5-1210-GGUFhighBBH CoTopenchat-3-5-1210TheBloke125openchat/openchat-3.5-121077.3
openchat-3.5-1210-GGUFlowGSM8Kopenchat-3-5-1210TheBloke126openchat/openchat-3.5-121077.3
openchat-3.5-0106-GGUFhighBBH CoTopenchat-3-5-0106TheBloke127openchat/openchat-3.5-010677.3
openchat_3.5-GGUFlowBBH CoTUnknownTheBloke128openchat/openchat_3.577.3
openchat_3.5-16k-GGUFlowBBH CoTUnknownTheBloke129NurtureAI/openchat_3.5-16k77.3
openchat-3.5-1210-GPTQhighBBH CoTopenchat-3-5-1210TheBloke130openchat/openchat-3.5-121077.3
openchat-3.5-1210-GPTQlowGSM8Kopenchat-3-5-1210TheBloke131openchat/openchat-3.5-121077.3
openchat_3.5-GPTQlowBBH CoTUnknownTheBloke132openchat/openchat_3.577.3
Falcon-H1-34B-BasemediumGSM8kfalcon-h1-34b-basetiiuae133tiiuae/Falcon-H1-34B-Base76.5
Qwen-72B-ChatlowGSM8Kqwen-72bQwen134Qwen/Qwen-72B76.4
Llama-3.1-Tulu-3-8B-SFTmedium**GSM8K (8 shot, CoT)**llama-3-1-8ballenai135meta-llama/Llama-3.1-8B76.2
Llama-3.1-Tulu-3-8Bmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-8b-dpoallenai136allenai/Llama-3.1-Tulu-3-8B-DPO76.2
Llama-3.1-Tulu-3-8B-DPOmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-8b-sftallenai137allenai/Llama-3.1-Tulu-3-8B-SFT76.2
Llama-3.1-Tulu-3-8B-RMmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-8b-sftallenai138allenai/Llama-3.1-Tulu-3-8B-SFT76.2
Llama-3.1-Tulu-3.1-8Bmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-8b-dpoallenai139allenai/Llama-3.1-Tulu-3-8B-DPO76.2
Llama-3.1-Tulu-3-70Bmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-70b-dpoallenai140allenai/Llama-3.1-Tulu-3-70B-DPO76.2
Llama-3.1-Tulu-3-70B-SFTmedium**GSM8K (8 shot, CoT)**llama-3-1-70ballenai141meta-llama/Llama-3.1-70B76.2
Llama-3.1-Tulu-3-405Bmedium**GSM8K (8 shot, CoT)**llama-3-1-405ballenai142allenai/Llama-3.1-Tulu-3-405B-DPO76.2
Llama-3.1-Tulu-3-70B-DPOmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-70b-sftallenai143allenai/Llama-3.1-Tulu-3-70B-SFT76.2
Llama-3.1-Tulu-3-8B-GGUFmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-8bunsloth144allenai/Llama-3.1-Tulu-3-8B76.2
Llama-3.1-Tulu-3-405B-SFTmedium**GSM8K (8 shot, CoT)**llama-3-1-405ballenai145meta-llama/Llama-3.1-405B76.2
Llama-3.1-Tulu-3-70B-GGUFmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-70bunsloth146allenai/Llama-3.1-Tulu-3-70B76.2
Llama-3.1-Tulu-3-405B-DPOmedium**GSM8K (8 shot, CoT)**llama-3-1-405ballenai147allenai/Llama-3.1-Tulu-3-405B-SFT76.2
UNA-ThePitbull-21.4B-v2-GGUFmediumgsm8kUnknownbartowski148—75.66
Qwen-72B-Chat-Int4highGSM8Kqwen-72bQwen149Qwen/Qwen-72B75.3
Falcon-H1-1.5B-InstructmediumGSM8kfalcon-h1-1-5b-basetiiuae150tiiuae/Falcon-H1-1.5B-Base74.98
Falcon-H1-1.5B-Instruct-GGUFmediumGSM8kfalcon-h1-1-5b-instructtiiuae151tiiuae/Falcon-H1-1.5B-Instruct74.98
Falcon-H1-1.5B-Instruct-GGUFmediumGSM8kfalcon-h1-1-5b-instructunsloth152tiiuae/Falcon-H1-1.5B-Instruct74.98
Falcon-H1-1.5B-Instruct-GPTQ-Int4mediumGSM8kfalcon-h1-1-5b-instructtiiuae153tiiuae/Falcon-H1-1.5B-Instruct74.98
Falcon-H1-1.5B-Instruct-GPTQ-Int8mediumGSM8kfalcon-h1-1-5b-instructtiiuae154tiiuae/Falcon-H1-1.5B-Instruct74.98
internlm2_5-7bmediumGSM8Kinternlm2-5-7binternlm155internlm/internlm2_5-7b74.8
OLMo-2-0425-1BlowGSM8Kolmo-2-0425-1ballenai156allenai/OLMo-2-0425-1B74.3
OLMo-2-0325-32B-InstructlowGSM8kolmo-2-0325-32ballenai157allenai/OLMo-2-0325-32B-DPO74.3
OLMo-2-0325-32B-Instruct-GGUFlowGSM8kolmo-2-0325-32b-instructunsloth158allenai/OLMo-2-0325-32B-Instruct74.3
OLMo-2-0325-32B-SFTlowGSM8kolmo-2-0325-32ballenai159allenai/OLMo-2-0325-32B74.3
OLMo-2-0325-32B-DPOlowGSM8kolmo-2-0325-32ballenai160allenai/OLMo-2-0325-32B-SFT74.3
OLMo-2-0325-32B-InstructlowGSM8kolmo-2-0325-32b-instructunsloth161allenai/OLMo-2-0325-32B-Instruct74.3
Qwen-72B-Chat-Int8highGSM8Kqwen-72bQwen162Qwen/Qwen-72B73.5
Falcon-H1-7B-BasemediumGSM8kfalcon-h1-7b-basetiiuae163tiiuae/Falcon-H1-7B-Base73.46
AceInstruct-7BmediumGSM8Kaceinstruct-7bnvidia164nvidia/AceInstruct-7B73.2
AceInstruct-1.5BmediumGSM8Kaceinstruct-1-5bnvidia165nvidia/AceInstruct-1.5B73.2
AceInstruct-72BmediumGSM8Kaceinstruct-72bnvidia166nvidia/AceInstruct-72B73.2
AceInstruct-1.5B-GGUFmediumGSM8Kaceinstruct-1-5bMungert167nvidia/AceInstruct-1.5B73.2
NeuralDaredevil-7BmediumGSM8k (5-shot)daredevil-7bmlabonne168mlabonne/Daredevil-7B73.16
Daredevil-7BmediumGSM8k (5-shot)mistral-7b-v0-1mlabonne169mistralai/Mistral-7B-v0.172.93
OLMoE-1B-7B-0125-Instructmedium**GSM8K**olmoe-1b-7b-0125-dpoallenai170allenai/OLMoE-1B-7B-0125-DPO72.4
OLMoE-1B-7B-0125-DPOmedium**GSM8K**olmoe-1b-7b-0125allenai171allenai/OLMoE-1B-7B-0125-SFT72.4
OLMoE-1B-7B-0125-SFTmedium**GSM8K**olmoe-1b-7b-0125allenai172allenai/OLMoE-1B-7B-012572.4
supermario-v2-GGUFmediumGSM8K (5-shot)supermario-v2TheBloke173janhq/supermario-v272.18
UNA-TheBeagle-7B-v1-GGUFmediumgsm8kuna-thebeagle-7b-v1TheBloke174fblgit/UNA-TheBeagle-7b-v172.1
Seraph-7B-GGUFmediumGSM8K (5-shot)seraph-7bTheBloke175Weyaxi/Seraph-7B71.87
Yi-34B-Chat-GGUFhighGSM8kyi-34b-chatTheBloke17601-ai/Yi-34B-Chat71.65
Yi-34B-Chat-AWQhighGSM8kyi-34b-chatTheBloke17701-ai/Yi-34B-Chat71.65
Beagle14-7BmediumGSM8k (5-shot)una-thebeagle-7b-v1mlabonne178fblgit/UNA-TheBeagle-7b-v171.42
Darewin-7BmediumGSM8k (5-shot)neural-chat-7b-v3-3mlabonne179Intel/neural-chat-7b-v3-371.04
Marcoro14-7B-slerpmediumGSM8k (5-shot)marcoro14-7b-slerpmlabonne180AIDC-ai-business/Marcoroni-7B-v370.89
internlm2-chat-7bmediumGSM8Kinternlm2-chat-7binternlm181internlm/internlm2-chat-7b70.8
internlm2-7bmediumGSM8KUnknowninternlm182internlm/internlm2-7b70.8
internlm2-chat-20bmediumGSM8Kinternlm2-chat-20binternlm183internlm/internlm2-chat-20b70.8
internlm2-20bmediumGSM8KUnknowninternlm184internlm/internlm2-20b70.8
internlm2-base-7bmediumGSM8KUnknowninternlm185internlm/internlm2-base-7b70.8
internlm2-base-20bmediumGSM8KUnknowninternlm186internlm/internlm2-base-20b70.8
internlm2-chat-7b-sftmediumGSM8Kinternlm2-chat-7b-sftinternlm187internlm/internlm2-chat-7b-sft70.8
internlm2-chat-20b-sftmediumGSM8Kinternlm2-chat-20b-sftinternlm188internlm/internlm2-chat-20b-sft70.8
c4ai-command-r-plus-GPTQlowGSM8kUnknownalpindale189—70.7
DiscoLM-70B-GGUFmediumGSM8Kdiscolm-70bTheBloke190DiscoResearch/DiscoLM-70b70.6
NexoNimbus-7B-GGUFmediumgsm8knexonimbus-7bTheBloke191abideen/NexoNimbus-7B70.35
OmniBeagle-7BmediumGSM8k (5-shot)beaglesempra-7bmlabonne192shadowml/BeagleSempra-7B70.05
go-bruins-GGUFlowGSM8kUnknownTheBloke193rwitz/go-bruins69.9
NeuralPipe-7B-slerpmediumGSM8k (5-shot)mistral-ft-optimized-1218mlabonne194OpenPipe/mistral-ft-optimized-121869.75
go-bruins-v2-GGUFlowGSM8kUnknownTheBloke195rwitz/go-bruins-v269.67
NeuralPipe-7B-tiesmediumGSM8k (5-shot)mistral-ft-optimized-1218mlabonne196OpenPipe/mistral-ft-optimized-121869.52
Monarch-7BmediumGSM8k (5-shot)omnitruthybeagle-7b-v0mlabonne197mlabonne/OmniTruthyBeagle-7B-v069.07
TenyxChat-7B-v1-GGUFhighGSM8ktenyxchat-7b-v1TheBloke198tenyx/TenyxChat-7B-v169
Falcon-H1-1.5B-Deep-BasemediumGSM8kfalcon-h1-1-5b-deep-basetiiuae199tiiuae/Falcon-H1-1.5B-Deep-Base68.69
gemma-2-9b-itmedium[GSM8K][]gemma-2-9bgoogle200google/gemma-2-9b68.6
gemma-2-27b-itmedium[GSM8K][]gemma-2-27bgoogle201google/gemma-2-27b68.6
gemma-2-9bmedium[GSM8K][]gemma-2-9bgoogle202google/gemma-2-9b68.6
gemma-2-27bmedium[GSM8K][]gemma-2-27bgoogle203google/gemma-2-27b68.6
Falcon-H1-0.5B-InstructmediumGSM8kfalcon-h1-0-5b-basetiiuae204tiiuae/Falcon-H1-0.5B-Base68.39
Falcon-H1-0.5B-Instruct-GGUFmediumGSM8kfalcon-h1-0-5b-basetiiuae205tiiuae/Falcon-H1-0.5B-Base68.39
Falcon-H1-0.5B-Instruct-GGUFmediumGSM8kfalcon-h1-0-5b-instructunsloth206tiiuae/Falcon-H1-0.5B-Instruct68.39
Falcon-H1-3B-BasemediumGSM8kfalcon-h1-3b-basetiiuae207tiiuae/Falcon-H1-3B-Base68.31
OpenHermes-2.5-neural-chat-v3-3-Slerp-GGUFmediumGSM8K (5-shot)openhermes-2-5-neural-chat-v3-3-slerpTheBloke208Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp67.78
NeuralDarewin-7BmediumGSM8k (5-shot)mistral-7b-v0-1mlabonne209mistralai/Mistral-7B-v0.166.72
UNAversal-8x7B-v1beta-GGUFmediumgsm8kunaversal-8x7b-v1betaTheBloke210fblgit/UNAversal-8x7B-v1beta66.03
Qwen2-57B-A14B-InstructmediumGSM8Kqwen2-57b-a14bQwen211Qwen/Qwen2-57B-A14B65.7
CarbonVillain-en-10.7B-v4-GGUFmediumGSM8K (5-shot)carbonvillain-en-10-7b-v4TheBloke212jeonsworld/CarbonVillain-en-10.7B-v465.58
Optimus-7B-GGUFmediumGSM8K (5-shot)optimus-7bTheBloke213Q-bert/Optimus-7B65.5
LUNA-SOLARkrautLM-Instruct-GGUFmediumgsm8kluna-solarkrautlm-instructTheBloke214fblgit/LUNA-SOLARkrautLM-Instruct64.67
LFM2.5-1.2B-Thinking-GGUFlowGSM8Klfm2-5-1-2b-thinkingunsloth215LiquidAI/LFM2.5-1.2B-Thinking64.52
LFM2.5-1.2B-Thinking-GGUFlowGSM8Klfm2-5-1-2b-baseMungert216LiquidAI/LFM2.5-1.2B-Base64.52
SauerkrautLM-SOLAR-Instruct-GGUFmediumGSM8K (5-shot)sauerkrautlm-solar-instructTheBloke217VAGOsolutions/SauerkrautLM-SOLAR-Instruct64.14
WizardMath-13B-V1.0-GGUFhighGSM8kUnknownTheBloke218WizardLM/WizardMath-13B-V1.063.9
DiscoLM-70B-GGUFmediumGSM8k (5-shot)discolm-70bTheBloke219DiscoResearch/DiscoLM-70b63.68
UNA-ThePitbull-21.4B-v2-GGUFmediumGSM8k (5-shot)Unknownbartowski220—63.53
gemma-3-270mmedium[GSM8K][]gemma-3-270mgoogle221google/gemma-3-270m62.8
gemma-3-270m-itmedium[GSM8K][]gemma-3-270mgoogle222google/gemma-3-270m62.8
gemma-3-270m-it-GGUFmedium[GSM8K][]gemma-3-270m-itunsloth223google/gemma-3-270m-it62.8
gemma-3-270m-itmedium[GSM8K][]gemma-3-270m-itunsloth224google/gemma-3-270m-it62.8
gemma-3-270m-it-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-270m-itunsloth225google/gemma-3-270m-it62.8
gemma-3-270m-it-qat-GGUFmedium[GSM8K][]gemma-3-270m-it-qat-q4-0-unquantizedunsloth226google/gemma-3-270m-it-qat-q4_0-unquantized62.8
gemma-3-270mmedium[GSM8K][]gemma-3-270munsloth227google/gemma-3-270m62.8
gemma-3-270m-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-270m-itunsloth228google/gemma-3-270m-it62.8
gemma-3-270m-it-qat-q4_0-unquantizedmedium[GSM8K][]gemma-3-270m-itgoogle229google/gemma-3-270m-it62.8
gemma-3-270m-it-bnb-4bitmedium[GSM8K][]gemma-3-270m-itunsloth230google/gemma-3-270m-it62.8
gemma-3-270m-it-qatmedium[GSM8K][]gemma-3-270m-it-qat-q4-0-unquantizedunsloth231google/gemma-3-270m-it-qat-q4_0-unquantized62.8
gemma-3-270m-bnb-4bitmedium[GSM8K][]gemma-3-270munsloth232google/gemma-3-270m62.8
gemma-3-270m-qat-q4_0-unquantizedmedium[GSM8K][]gemma-3-270mgoogle233google/gemma-3-270m62.8
gemma-3-270m-it-GGUFmedium[GSM8K][]gemma-3-270mMungert234google/gemma-3-270m62.8
gemma-3-270m-it-torchao-FP8medium[GSM8K][]gemma-3-270m-itunsloth235google/gemma-3-270m-it62.8
smol-7B-GGUFlowGSM8Ksmol-7bTheBloke236rishiraj/smol-7b62.32
neural-chat-7B-v3-3-GGUFmediumGSM8K (5-shot)neural-chat-7b-v3-3TheBloke237Intel/neural-chat-7b-v3-361.11
neural-chat-7B-v3-3-GPTQmediumGSM8K (5-shot)neural-chat-7b-v3-3TheBloke238Intel/neural-chat-7b-v3-361.11
PlatYi-34B-Llama-Q-v3-GGUFhighGSM8Kplatyi-34b-llama-q-v3TheBloke239kyujinpy/PlatYi-34B-Llama-Q-v360.42
Falcon-H1-0.5B-BasemediumGSM8kfalcon-h1-0-5b-basetiiuae240tiiuae/Falcon-H1-0.5B-Base60.2
Qwen-14B-ChatlowGSM8Kqwen-14b-chatQwen241Qwen/Qwen-14B-Chat60.1
Qwen-14B-Chat-GPTQlowGSM8Kqwen-14b-chatTheBloke242Qwen/Qwen-14B-Chat60.1
Qwen-14B-Chat-AWQlowGSM8Kqwen-14b-chatTheBloke243Qwen/Qwen-14B-Chat60.1
Qwen-14B-Chat-Int8highGSM8Kqwen-14bQwen244Qwen/Qwen-14B60
Qwen2-57B-A14BmediumGSM8Kqwen2-57b-a14bQwen245Qwen/Qwen2-57B-A14B59.9
Qwen-14B-Chat-Int4highGSM8Kqwen-14bQwen246Qwen/Qwen-14B59.8
LFM2-1.2B-GGUFhighGSM8Klfm2-1-2bunsloth247LiquidAI/LFM2-1.2B58.3
LFM2-1.2B-unsloth-bnb-4bithighGSM8Klfm2-1-2bunsloth248LiquidAI/LFM2-1.2B58.3
LFM2-1.2BhighGSM8Klfm2-1-2bunsloth249LiquidAI/LFM2-1.2B58.3
Nanbeige-16B-Base-GGUFhighGSM8KUnknownTheBloke250Nanbeige/Nanbeige-16B-Base57.62
Qwen2-0.5BmediumGSM8Kqwen2-0-5bQwen251Qwen/Qwen2-0.5B57.2
Qwen2-1.5BmediumGSM8Kqwen2-1-5bQwen252Qwen/Qwen2-1.5B57.2
llama-3-tulu-2-8blowGSM8k 8-shot cot | BBH 3-shot cotmeta-llama-3-8ballenai253meta-llama/Meta-Llama-3-8B56.5
llama-3-tulu-2-70blowGSM8k 8-shot cot | BBH 3-shot cotmeta-llama-3-70ballenai254meta-llama/Meta-Llama-3-70B56.5
NeuralHermes-2.5-Mistral-7B-lasermediumGSM8k (5-shot)openhermes-2-5-mistral-7bmlabonne255teknium/OpenHermes-2.5-Mistral-7B55.72
Hunyuan-7B-Instruct-GGUFmediumGSM8Khunyuan-7b-pretrainMungert256tencent/Hunyuan-7B-Pretrain55.64
una-xaberius-34b-v1beta-GGUFlowGSM8K (5-s)una-xaberius-34b-v1betaTheBloke257fblgit/una-xaberius-34b-v1beta55.12
WizardMath-7B-V1.0-GGUFhighGSM8kUnknownTheBloke258WizardLM/WizardMath-7b-V1.054.9
falcon-11BmediumGSM8k-5shotsfalcon-11btiiuae259tiiuae/falcon-11B53.83
internlm2-math-plus-1_8blowGSM8Kinternlm2-math-plus-1-8binternlm260internlm/internlm2-math-plus-1_8b53.8
falcon-mamba-7blow`GSM8K`falcon-mamba-7btiiuae261tiiuae/falcon-mamba-7b52.54
falcon-mamba-7b-instructlow`GSM8K`falcon-mamba-7btiiuae262tiiuae/falcon-mamba-7b52.54
falcon-mamba-7b-instruct-Q4_K_M-GGUFlow`GSM8K`falcon-mamba-7b-instructtiiuae263tiiuae/falcon-mamba-7b-instruct52.54
falcon-mamba-7b-instruct-4bitlow`GSM8K`falcon-mamba-7b-instructtiiuae264tiiuae/falcon-mamba-7b-instruct52.54
falcon-mamba-7b-Q8_0-GGUFlow`GSM8K`falcon-mamba-7btiiuae265tiiuae/falcon-mamba-7b52.54
falcon-mamba-7b-F16-GGUFlow`GSM8K`falcon-mamba-7btiiuae266tiiuae/falcon-mamba-7b52.54
falcon-mamba-7b-4bitlow`GSM8K`falcon-mamba-7btiiuae267tiiuae/falcon-mamba-7b52.54
Qwen2-7BmediumGSM8Kqwen2-7bQwen268Qwen/Qwen2-7B52.2
Falcon-H1-1.5B-BasemediumGSM8kfalcon-h1-1-5b-basetiiuae269tiiuae/Falcon-H1-1.5B-Base52.01
Qwen-7B-ChatlowGSM8Kqwen-7b-chatQwen270Qwen/Qwen-7B-Chat50.3
Qwen-7B-Chat-GPTQlowGSM8Kqwen-7b-chatTheBloke271Qwen/Qwen-7B-Chat50.3
Qwen-7B-Chat-AWQlowGSM8Kqwen-7b-chatTheBloke272Qwen/Qwen-7B-Chat50.3
Qwen-7B-Chat-Int4highGSM8Kqwen-7bQwen273Qwen/Qwen-7B49.7
juanako-7B-UNA-GGUFmediumgsm8kjuanako-7b-unaTheBloke274fblgit/juanako-7b-UNA48.98
bagel-dpo-7B-v0.1-GGUFlowgsm8kbagel-dpo-7b-v0-1TheBloke275jondurbin/bagel-dpo-7b-v0.148.52
Qwen-7B-Chat-Int8highGSM8Kqwen-7bQwen276Qwen/Qwen-7B48.3
LFM2-700MhighGSM8Klfm2-700munsloth277LiquidAI/LFM2-700M46.4
LFM2-700M-GGUFhighGSM8Klfm2-700munsloth278LiquidAI/LFM2-700M46.4
juanako-7B-v1-GGUFmediumgsm8kjuanako-7b-v1TheBloke279fblgit/juanako-7b-v145.56
stablelm-zephyr-3b-GGUFmediumGSM8K (5-shot)stablelm-zephyr-3bTheBloke280stabilityai/stablelm-zephyr-3b42.3
gemma-3-1b-itmedium[GSM8K][]gemma-3-1b-itgoogle281google/gemma-3-1b-pt38.4
gemma-3-4b-itmedium[GSM8K][]gemma-3-4b-itgoogle282google/gemma-3-4b-pt38.4
gemma-3-12b-itmedium[GSM8K][]gemma-3-12b-ptgoogle283google/gemma-3-12b-pt38.4
gemma-3-27b-itmedium[GSM8K][]gemma-3-27b-ptgoogle284google/gemma-3-27b-pt38.4
gemma-3-4b-itmedium[GSM8K][]gemma-3-4b-itunsloth285google/gemma-3-4b-it38.4
gemma-3-1b-it-GGUFmedium[GSM8K][]gemma-3-1b-itggml-org286google/gemma-3-1b-it38.4
gemma-3-12b-it-qat-q4_0-unquantizedmedium[GSM8K][]gemma-3-12b-itgoogle287google/gemma-3-12b-it38.4
gemma-3-1b-itmedium[GSM8K][]gemma-3-1b-itunsloth288google/gemma-3-1b-it38.4
gemma-3-12b-it-GGUFmedium[GSM8K][]gemma-3-12b-itunsloth289google/gemma-3-12b-it38.4
gemma-3-4b-ptmedium[GSM8K][]gemma-3-4b-ptgoogle290google/gemma-3-4b-pt38.4
gemma-3-12b-it-qat-GGUFmedium[GSM8K][]gemma-3-12b-it-qat-q4-0-unquantizedunsloth291google/gemma-3-12b-it-qat-q4_0-unquantized38.4
gemma-3-27b-itmedium[GSM8K][]gemma-3-27b-itunsloth292google/gemma-3-27b-it38.4
gemma-3-1b-ptmedium[GSM8K][]gemma-3-1b-ptgoogle293google/gemma-3-1b-pt38.4
gemma-3-4b-it-GGUFmedium[GSM8K][]gemma-3-4b-itggml-org294google/gemma-3-4b-it38.4
gemma-3-4b-it-GGUFmedium[GSM8K][]gemma-3-4b-itunsloth295google/gemma-3-4b-it38.4
gemma-3-1b-it-GGUFmedium[GSM8K][]gemma-3-1b-itunsloth296google/gemma-3-1b-it38.4
gemma-3-12b-ptmedium[GSM8K][]gemma-3-12b-ptgoogle297google/gemma-3-12b38.4
gemma-3-12b-it-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-12b-itunsloth298google/gemma-3-12b-it38.4
gemma-3-4b-it-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-4b-itunsloth299google/gemma-3-4b-it38.4
gemma-3-12b-itmedium[GSM8K][]gemma-3-12b-ptunsloth300google/gemma-3-12b-pt38.4
gemma-3-27b-it-GGUFmedium[GSM8K][]gemma-3-27b-itunsloth301google/gemma-3-27b-it38.4
gemma-3-1b-it-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-1b-itunsloth302google/gemma-3-1b-it38.4
gemma-3-4b-it-bnb-4bitmedium[GSM8K][]gemma-3-4b-itunsloth303google/gemma-3-4b-it38.4
gemma-3-4b-ptmedium[GSM8K][]gemma-3-4b-ptunsloth304google/gemma-3-4b-pt38.4
gemma-3-27b-ptmedium[GSM8K][]gemma-3-27b-ptgoogle305google/gemma-3-27b-pt38.4
gemma-3-12b-it-bnb-4bitmedium[GSM8K][]gemma-3-12b-itunsloth306google/gemma-3-12b-it38.4
gemma-3-27b-it-GGUFmedium[GSM8K][]gemma-3-27b-itggml-org307google/gemma-3-27b-it38.4
gemma-3-12b-ptmedium[GSM8K][]gemma-3-12b-ptunsloth308google/gemma-3-12b-pt38.4
gemma-3-27b-it-bnb-4bitmedium[GSM8K][]gemma-3-27b-itunsloth309google/gemma-3-27b-it38.4
gemma-3-27b-it-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-27b-itunsloth310google/gemma-3-27b-it38.4
gemma-3-1b-ptmedium[GSM8K][]gemma-3-1b-ptunsloth311google/gemma-3-1b-pt38.4
gemma-3-12b-it-GGUFmedium[GSM8K][]gemma-3-12b-itggml-org312google/gemma-3-12b-it38.4
gemma-3-4b-it-qat-GGUFmedium[GSM8K][]gemma-3-4b-it-qat-q4-0-unquantizedunsloth313google/gemma-3-4b-it-qat-q4_0-unquantized38.4
gemma-3-12b-it-qat-bnb-4bitmedium[GSM8K][]gemma-3-12b-it-qat-q4-0-unquantizedunsloth314google/gemma-3-12b-it-qat-q4_0-unquantized38.4
gemma-3-12b-it-qat-int4-GGUFmedium[GSM8K][]gemma-3-12b-it-qat-int4-unquantizedunsloth315google/gemma-3-12b-it-qat-int4-unquantized38.4
gemma-3-4b-it-qat-q4_0-ggufmedium[GSM8K][]gemma-3-4b-itgoogle316google/gemma-3-4b-it38.4
gemma-3-4b-it-qat-q4_0-unquantizedmedium[GSM8K][]gemma-3-4b-itgoogle317google/gemma-3-4b-it38.4
gemma-3-4b-pt-bnb-4bitmedium[GSM8K][]gemma-3-4b-ptunsloth318google/gemma-3-4b-pt38.4
gemma-3-27b-it-qat-GGUFmedium[GSM8K][]gemma-3-27b-it-qat-q4-0-unquantizedunsloth319google/gemma-3-27b-it-qat-q4_0-unquantized38.4
gemma-3-12b-it-qat-q4_0-ggufmedium[GSM8K][]gemma-3-12b-itgoogle320google/gemma-3-12b-it38.4
gemma-3-1b-it-bnb-4bitmedium[GSM8K][]gemma-3-1b-itunsloth321google/gemma-3-1b-it38.4
gemma-3-1b-it-qat-q4_0-ggufmedium[GSM8K][]gemma-3-1b-itgoogle322google/gemma-3-1b-it38.4
gemma-3-4b-pt-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-4b-ptunsloth323google/gemma-3-4b-pt38.4
gemma-3-12b-it-qatmedium[GSM8K][]gemma-3-12b-it-qat-q4-0-unquantizedunsloth324google/gemma-3-12b-it-qat-q4_0-unquantized38.4
gemma-3-1b-pt-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-1b-ptunsloth325google/gemma-3-1b-pt38.4
gemma-3-4b-it-FP8-Dynamicmedium[GSM8K][]gemma-3-4b-itunsloth326google/gemma-3-4b-it38.4
gemma-3-12b-pt-bnb-4bitmedium[GSM8K][]gemma-3-12b-ptunsloth327google/gemma-3-12b-pt38.4
gemma-3-12b-it-qat-int4-unquantizedmedium[GSM8K][]gemma-3-12b-itgoogle328google/gemma-3-12b-it38.4
gemma-3-27b-it-GGUFmedium[GSM8K][]gemma-3-27b-ptMungert329google/gemma-3-27b-pt38.4
gemma-3-27b-it-qat-q4_0-unquantizedmedium[GSM8K][]gemma-3-27b-itgoogle330google/gemma-3-27b-it38.4
gemma-3-12b-pt-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-12b-ptunsloth331google/gemma-3-12b-pt38.4
gemma-3-27b-it-qat-q4_0-ggufmedium[GSM8K][]gemma-3-27b-itgoogle332google/gemma-3-27b-it38.4
gemma-3-27b-it-qat-q4_0-GGUFmedium[GSM8K][]gemma-3-27b-itMungert333google/gemma-3-27b-it38.4
gemma-3-4b-it-qat-bnb-4bitmedium[GSM8K][]gemma-3-4b-it-qat-q4-0-unquantizedunsloth334google/gemma-3-4b-it-qat-q4_0-unquantized38.4
gemma-3-1b-pt-bnb-4bitmedium[GSM8K][]gemma-3-1b-ptunsloth335google/gemma-3-1b-pt38.4
gemma-3-27b-ptmedium[GSM8K][]gemma-3-27b-ptunsloth336google/gemma-3-27b-pt38.4
gemma-3-12b-it-FP8-Dynamicmedium[GSM8K][]gemma-3-12b-ptunsloth337google/gemma-3-12b-pt38.4
gemma-3-1b-it-qat-int4-unquantizedmedium[GSM8K][]gemma-3-1b-itgoogle338google/gemma-3-1b-it38.4
gemma-3-27b-pt-bnb-4bitmedium[GSM8K][]gemma-3-27b-ptunsloth339google/gemma-3-27b-pt38.4
gemma-3-12b-it-qat-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-12b-it-qat-q4-0-unquantizedunsloth340google/gemma-3-12b-it-qat-q4_0-unquantized38.4
gemma-3-12b-pt-qat-q4_0-ggufmedium[GSM8K][]gemma-3-12b-ptgoogle341google/gemma-3-12b-pt38.4
gemma-3-4b-it-qatmedium[GSM8K][]gemma-3-4b-it-qat-q4-0-unquantizedunsloth342google/gemma-3-4b-it-qat-q4_0-unquantized38.4
gemma-3-1b-it-qat-q4_0-unquantizedmedium[GSM8K][]gemma-3-1b-itgoogle343google/gemma-3-1b-it38.4
gemma-3-1b-it-qatmedium[GSM8K][]gemma-3-1b-it-qat-q4-0-unquantizedunsloth344google/gemma-3-1b-it-qat-q4_0-unquantized38.4
gemma-3-27b-it-qatmedium[GSM8K][]gemma-3-27b-it-qat-q4-0-unquantizedunsloth345google/gemma-3-27b-it-qat-q4_0-unquantized38.4
gemma-3-4b-pt-qat-q4_0-ggufmedium[GSM8K][]gemma-3-4b-ptgoogle346google/gemma-3-4b-pt38.4
bitnet-b1.58-2B-4T-ggufmediumGSM8Kbitnet-b1-58-2b-4t-bf16microsoft347microsoft/bitnet-b1.58-2B-4T-bf1638.21
bitnet-b1.58-2B-4TmediumGSM8Kbitnet-b1-58-2b-4tmicrosoft348microsoft/bitnet-b1.58-2B-4T38.21
bitnet-b1.58-2B-4T-bf16mediumGSM8Kbitnet-b1-58-2b-4t-bf16microsoft349microsoft/bitnet-b1.58-2B-4T-bf1638.21
rocket-3B-GGUFmediumGSM8K (5-shot)rocket-3bTheBloke350pansophic/rocket-3B37.91
una-cybertron-7B-v2-GGUFlowGSM8K (5-s)una-cybertron-7b-v2-bf16TheBloke351fblgit/una-cybertron-7b-v2-bf1637.83
speechless-mistral-moloras-7B-GGUFmediumGSM8Kspeechless-mistral-moloras-7bTheBloke352uukuguy/speechless-mistral-moloras-7b37.68
llemma_7b-GGUFhighGSM8kUnknownTheBloke353EleutherAI/llemma_7b36.4
llemma_34b-GGUFhighGSM8kUnknownTheBloke354EleutherAI/llemma_34b36.4
rho-math-1b-v0.1low**GSM8K**rho-math-1b-v0-1microsoft355microsoft/rho-math-1b-v0.136.1
rho-math-7b-interpreter-v0.1low**GSM8K**rho-math-7b-interpreter-v0-1microsoft356microsoft/rho-math-7b-interpreter-v0.136.1
rho-math-7b-v0.1low**GSM8K**rho-math-7b-v0-1microsoft357microsoft/rho-math-7b-v0.136.1
rho-math-1b-interpreter-v0.1low**GSM8K**rho-math-1b-interpreter-v0-1microsoft358microsoft/rho-math-1b-interpreter-v0.136.1
internlm-chat-7bmediumGSM8KUnknowninternlm359internlm/internlm-chat-7b34.5
internlm-7bmediumGSM8KUnknowninternlm360internlm/internlm-7b34.5
Qwen-1_8B-Chat-Int8highGSM8Kqwen-1-8bQwen361Qwen/Qwen-1_8B33
Ministral-8B-Instruct-2410lowGSM8K maj@8ministral-8b-instruct-2410mistralai362mistralai/Ministral-8B-Instruct-241032
internlm2-chat-1_8bmediumGSM8Kinternlm2-chat-1-8binternlm363internlm/internlm2-chat-1_8b31.2
internlm2-1_8bmediumGSM8KUnknowninternlm364internlm/internlm2-1_8b31.2
Qwen-1_8B-Chat-Int4highGSM8Kqwen-1-8bQwen365Qwen/Qwen-1_8B31.2
internlm2-chat-1_8b-sftmediumGSM8Kinternlm2-chat-1-8b-sftinternlm366internlm/internlm2-chat-1_8b-sft31.2
SmolLM2-1.7B-Instruct-GGUFmediumGSM8K (5-shot)smollm2-1-7bMungert367HuggingFaceTB/SmolLM2-1.7B31
LFM2-350MhighGSM8Klfm2-350munsloth368LiquidAI/LFM2-350M30.1
LFM2-350M-GGUFhighGSM8Klfm2-350munsloth369LiquidAI/LFM2-350M30.1
LFM2-350M-unsloth-bnb-4bithighGSM8Klfm2-350munsloth370LiquidAI/LFM2-350M30.1
digital-socrates-13bmediumGSM8k (5-shot)Unknownallenai371allenai/digital-socrates-13b29.49
OLMo-2-1124-7BlowGSM8kolmo-2-1124-7ballenai372allenai/OLMo-2-1124-7B28.1
OLMo-2-1124-13BlowGSM8kolmo-2-1124-13ballenai373allenai/OLMo-2-1124-13B28.1
OLMo-2-0325-32BlowGSM8kolmo-2-0325-32ballenai374allenai/OLMo-2-0325-32B28.1
koOpenChat-sft-GGUFmediumGSM8K (5-shot)UnknownTheBloke375maywell/koOpenChat-sft24.18
gemma-2-2b-itmedium[GSM8K][]gemma-2-2bgoogle376google/gemma-2-2b23.9
gemma-2-2bmedium[GSM8K][]gemma-2-2bgoogle377google/gemma-2-2b23.9
Synatra-7B-v0.3-dpo-GGUFmediumGSM8K (5-shot)UnknownTheBloke378maywell/Synatra-7B-v0.3-dpo23.73
speechless-mistral-dolphin-orca-platypus-samantha-7B-GGUFmediumGSM8Kspeechless-mistral-dolphin-orca-platypus-samantha-7bTheBloke379uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7b21.38
Synatra-7B-v0.3-RP-GGUFmediumGSM8K (5-shot)UnknownTheBloke380maywell/Synatra-7B-v0.3-RP21.15
loyal-piano-m7-GGUFlowGSM8Kloyal-piano-m7TheBloke381chargoddard/loyal-piano-m720.7
speechless-mistral-7B-dare-0.85-GGUFlowGSM8Kspeechless-mistral-7b-dare-0-85TheBloke382speechlessai/speechless-mistral-7b-dare-0.8519.56
SynthIA-7B-v1.3-dare-0.85-GGUFlowGSM8KUnknownTheBloke383uukuguy/SynthIA-7B-v1.3-dare-0.8519.56
airoboros-m-7B-3.1.2-dare-0.85-GGUFlowGSM8KUnknownTheBloke384uukuguy/airoboros-m-7b-3.1.2-dare-0.8519.56
CollectiveCognition-v1.1-Mistral-7B-dare-0.85-GGUFlowGSM8KUnknownTheBloke385uukuguy/CollectiveCognition-v1.1-Mistral-7B-dare-0.8519.56
Synatra-V0.1-7B-Instruct-GGUFmediumGSM8K (5-shot)UnknownTheBloke386maywell/Synatra-V0.1-7B-Instruct19.41
Darewin-7B-v2mediumGSM8k (5-shot)mistral-ft-optimized-1227mlabonne387OpenPipe/mistral-ft-optimized-122719.18
Dr_Samantha-7B-GGUFlowGSM8Kdr-samantha-7bTheBloke388sethuiyer/Dr_Samantha-7b18.8
neural-chat-7B-v3-1-GGUFlowGSM8K (5-s)neural-chat-7b-v3-1TheBloke389Intel/neural-chat-7b-v3-118.12
digital-socrates-7bmediumGSM8k (5-shot)Unknownallenai390allenai/digital-socrates-7b17.89
Skywork-13B-base-GGUFlowGSM8KUnknownTheBloke391Skywork/Skywork-13B-base17.8
gemma-1.1-2b-itmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-1-1-2b-itgoogle392google/gemma-1.1-2b-it17.7
gemma-2bmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-2b-itgoogle393google/gemma-2b-it-pytorch17.7
gemma-2b-itmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-2b-itgoogle394google/gemma-2b-it-pytorch17.7
gemma-7bmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-7b-itgoogle395google/gemma-7b-it-quant-pytorch17.7
gemma-7b-itmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-7bgoogle396google/gemma-7b17.7
gemma-1.1-7b-itmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-1-1-7b-itgoogle397google/gemma-1.1-7b-it17.7
gemma-2b-AWQmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-2b-itgoogle398google/gemma-2b-it-pytorch17.7
gemma-7bmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-7b-italpindale399google/gemma-7b-it-quant-pytorch17.7
gemma-2bmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-2b-italpindale400google/gemma-2b-it-pytorch17.7
gemma-7b-AWQmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-7b-itgoogle401google/gemma-7b-it-quant-pytorch17.7
gemma-7b-itmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-7b-italpindale402google/gemma-7b-it-quant-pytorch17.7
gemma-7b-GGUFmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-7b-itgoogle403google/gemma-7b-it-quant-pytorch17.7
DeepSeek-V2-Lite-Chatmedium**GSM8K**deepseek-v2-lite-chatdeepseek-ai404deepseek-ai/DeepSeek-V2-Lite-Chat17.4
DeepSeek-V2-Litemedium**GSM8K**deepseek-v2-litedeepseek-ai405deepseek-ai/DeepSeek-V2-Lite17.4
Qwen-72BlowGSM8Kqwen-72bQwen406Qwen/Qwen-72B16.7
Qwen-7BlowGSM8Kqwen-7bQwen407Qwen/Qwen-7B16.7
Qwen-14BlowGSM8Kqwen-14bQwen408Qwen/Qwen-14B16.7
notus-7B-v1-GGUFlowGSM8Knotus-7b-v1TheBloke409argilla/notus-7b-v112.74
notus-7B-v1-AWQlowGSM8Knotus-7b-v1TheBloke410argilla/notus-7b-v112.74
internlm2-math-7blowGSM8Kinternlm2-math-7binternlm411internlm/internlm2-math-7b11.8
internlm2-math-base-7blowGSM8Kinternlm2-math-base-7binternlm412internlm/internlm2-math-base-7b11.8
internlm2-math-20blowGSM8Kinternlm2-math-20binternlm413internlm/internlm2-math-20b11.8
internlm2-math-base-20blowGSM8Kinternlm2-math-base-20binternlm414internlm/internlm2-math-base-20b11.8
Qwen2-1.5B-InstructmediumGSM8Kqwen2-1-5b-instructQwen415Qwen/Qwen2-1.5B-Instruct11.3
Qwen2-0.5B-InstructmediumGSM8Kqwen2-0-5bQwen416Qwen/Qwen2-0.5B11.3
OLMo-2-0425-1B-InstructlowGSM8Kolmo-2-0425-1b-rlvr1allenai417allenai/OLMo-2-0425-1B-RLVR110.8
OLMo-2-0425-1B-SFTlowGSM8Kolmo-2-0425-1ballenai418allenai/OLMo-2-0425-1B10.8
OLMo-2-0425-1B-DPOlowGSM8Kolmo-2-0425-1ballenai419allenai/OLMo-2-0425-1B-SFT10.8
OLMo-2-0425-1B-Instruct-GGUFlowGSM8Kolmo-2-0425-1b-instructunsloth420allenai/OLMo-2-0425-1B-Instruct10.8
OLMo-2-0425-1B-InstructlowGSM8Kolmo-2-0425-1b-instructunsloth421allenai/OLMo-2-0425-1B-Instruct10.8
OLMo-2-0425-1B-RLVR1lowGSM8Kolmo-2-0425-1ballenai422allenai/OLMo-2-0425-1B-DPO10.8
Gemmalpaca-2BmediumGSM8k (5-shot)gemma-2bmlabonne423google/gemma-2b10.69
OLMo-1B-0724-hfmediumGSM8kolmo-1b-0724-hfallenai424allenai/OLMo-1B-0724-hf10
OLMo-7B-0424-hfmediumGSM8kolmo-7b-0424-hfallenai425allenai/OLMo-7B-0424-hf10
OLMo-7B-0724-hfmediumGSM8kolmo-7b-0724-hfallenai426allenai/OLMo-7B-0724-hf10
OLMo-7B-0424mediumGSM8kUnknownallenai427allenai/OLMo-7B-042410
MLewd-v2.4-13B-GGUFmediumGSM8K (5-shot)UnknownTheBloke428Undi95/MLewd-v2.4-13B9.78
llama2-7B-layla-GGUFmediumGSM8K (5-shot)UnknownTheBloke429l3utterfly/llama2-7b-layla8.49
MetaMath-Mistral-7B-GGUFlowGSM8k Pass@1UnknownTheBloke430meta-math/MetaMath-Mistral-7B6.8
Arithmo-Mistral-7B-GGUFlowGSM8k Pass@1UnknownTheBloke431akjindal53244/Arithmo-Mistral-7B6.8
SmolLM2-360M-Instruct-GGUFmediumGSM8K (5-shot)smollm2-360mMungert432HuggingFaceTB/SmolLM2-360M3.2
open-llama-3b-v2-wizard-evol-instuct-v2-196k-GGUFmediumGSM8K (5-shot)open-llama-3b-v2-wizard-evol-instuct-v2-196kTheBloke433harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196k1.9
t5gemma-2-270m-270mmedium[GSM8K]t5gemma-2-270m-270mgoogle434google/t5gemma-2-270m-270m1.7
t5gemma-2-4b-4bmedium[GSM8K]t5gemma-2-4b-4bgoogle435google/t5gemma-2-4b-4b1.7
t5gemma-2-1b-1bmedium[GSM8K]t5gemma-2-1b-1bgoogle436google/t5gemma-2-1b-1b1.7
SmolLM2-135M-Instruct-GGUFmediumGSM8K (5-shot)smollm2-135mMungert437HuggingFaceTB/SmolLM2-135M1.4
Provenance & metadata (1)

source

kind
leaderboard-scrape
paths
benchmarks/gsm8k.html, docs/notes/hf-benchmark-contexts.json