Local AI Registry

Leaderboard

GSM8K

gsm8k
JSON APIBack to leaderboard search

Record

Category
math
Scored models
439

Scores

ModelScore
inclusionAI/LLaDA2.0-flash96.36
nvidia/AceMath-7B-RM96.22
nvidia/AceMath-72B-RM96.22
MiniMaxAI/MiniMax-Text-01-hf95.6
MiniMaxAI/MiniMax-Text-0195.6
inclusionAI/LLaDA2.0-flash-preview95.45
inclusionAI/LLaDA2.0-mini-preview94.62
google/diffusiongemma-26B-A4B-it94.54
nvidia/Nemotron-H-56B-Base-8K93.71
inclusionAI/LLaDA2.0-mini93.63
nvidia/Nemotron-H-56B-Base-8K93.3
Qwen/Qwen2-72B93
mistralai/Mistral-Large-Instruct-240793
tencent/Hunyuan-A13B-Instruct92.8
nvidia/AceMath-RL-Nemotron-7B92.7
nvidia/AceMath-RL-Nemotron-7B92.7
nvidia/Nemotron-Labs-TwoTower-30B-A3B-Base-BF1692.49
llm-agents/tora-code-34b-v1.092
llm-agents/tora-code-13b-v1.092
llm-agents/tora-7b-v1.092
llm-agents/tora-13b-v1.092
llm-agents/tora-70b-v1.092
llm-agents/tora-code-7b-v1.092
internlm/internlm2-math-plus-mixtral8x22b91.8

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category
math
id
gsm8k
name
GSM8K
schema version
local-ai-registry/v1

rows

variantconfcontextmodel idorgrankrootscore
LLaDA2.0-flashmediumGSM8Kllada2-0-flashinclusionAI1inclusionAI/LLaDA2.0-flash96.36
AceMath-7B-RMlowUnknownacemath-7b-rmnvidia2nvidia/AceMath-7B-RM96.22
AceMath-72B-RMlowUnknownacemath-72b-rmnvidia3nvidia/AceMath-72B-RM96.22
MiniMax-Text-01-hfmediumGSM8k<sup>*</sup>minimax-text-01-hfMiniMaxAI4MiniMaxAI/MiniMax-Text-01-hf95.6
MiniMax-Text-01mediumGSM8k<sup>*</sup>minimax-text-01MiniMaxAI5MiniMaxAI/MiniMax-Text-0195.6
LLaDA2.0-flash-previewmediumGSM8Kllada2-0-flash-previewinclusionAI6inclusionAI/LLaDA2.0-flash-preview95.45
LLaDA2.0-mini-previewmediumGSM8Kllada2-0-mini-previewinclusionAI7inclusionAI/LLaDA2.0-mini-preview94.62
diffusiongemma-26B-A4B-it-NVFP4mediumGSM8Kdiffusiongemma-26b-a4b-itnvidia8google/diffusiongemma-26B-A4B-it94.54
Nemotron-H-56B-Base-8KlowGSM8K 8-shot CoT | MATH 4-shot CoT | MATH-Lvl 5 4-shot CoT | MATH-500 4-shot CoTnemotron-h-56b-base-8knvidia9nvidia/Nemotron-H-56B-Base-8K93.71
LLaDA2.0-minimediumGSM8Kllada2-0-miniinclusionAI10inclusionAI/LLaDA2.0-mini93.63
Nemotron-H-47B-Base-8KlowGSM8K 8-shot CoT | MATH 4-shot CoT | MATH-Lvl 5 4-shot CoT | MATH-500 4-shot CoTnemotron-h-56b-base-8knvidia11nvidia/Nemotron-H-56B-Base-8K93.3
Qwen2-72B-InstructmediumGSM8Kqwen2-72bQwen12Qwen/Qwen2-72B93
Mistral-Large-Instruct-2407mediumGSM8Kmistral-large-instruct-2407mistralai13mistralai/Mistral-Large-Instruct-240793
Hunyuan-A13B-Instruct-GGUFmediumGSM8khunyuan-a13b-instructunsloth14tencent/Hunyuan-A13B-Instruct92.8
AceMath-RL-Nemotron-7BlowUnknownacemath-rl-nemotron-7bnvidia15nvidia/AceMath-RL-Nemotron-7B92.7
AceMath-RL-Nemotron-7B-GGUFlowUnknownacemath-rl-nemotron-7bMungert16nvidia/AceMath-RL-Nemotron-7B92.7
Nemotron-Labs-TwoTower-30B-A3B-Base-BF16mediumGSM8K (8-shot, acc)nemotron-labs-twotower-30b-a3b-base-bf16nvidia17nvidia/Nemotron-Labs-TwoTower-30B-A3B-Base-BF1692.49
tora-code-34b-v1.0-GGUFlowUnknownUnknownTheBloke18llm-agents/tora-code-34b-v1.092
tora-code-13B-v1.0-GGUFlowUnknownUnknownTheBloke19llm-agents/tora-code-13b-v1.092
tora-7B-v1.0-GGUFlowUnknownUnknownTheBloke20llm-agents/tora-7b-v1.092
tora-13B-v1.0-GGUFlowUnknownUnknownTheBloke21llm-agents/tora-13b-v1.092
tora-70B-v1.0-GGUFlowUnknownUnknownTheBloke22llm-agents/tora-70b-v1.092
tora-code-7B-v1.0-GGUFlowUnknownUnknownTheBloke23llm-agents/tora-code-7b-v1.092
internlm2-math-plus-mixtral8x22bhighUnknowninternlm2-math-plus-mixtral8x22binternlm24internlm/internlm2-math-plus-mixtral8x22b91.8
NVIDIA-Nemotron-Nano-9B-v2-BasemediumGSM8K CoTnvidia-nemotron-nano-9b-v2-basenvidia25nvidia/NVIDIA-Nemotron-Nano-9B-v2-Base91.66
NVIDIA-Nemotron-Nano-12B-v2-BasemediumGSM8K CoTnvidia-nemotron-nano-12b-v2-basenvidia26nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base91.66
DeepSeek-V4-FlashmediumGSM8K (EM)deepseek-v4-flashdeepseek-ai27deepseek-ai/DeepSeek-V4-Flash91.1
DeepSeek-V4-PromediumGSM8K (EM)deepseek-v4-prodeepseek-ai28deepseek-ai/DeepSeek-V4-Pro91.1
DeepSeek-V4-Flash-DSparkmediumGSM8K (EM)Unknowndeepseek-ai29—91.1
DeepSeek-V4-Flash-GGUFmediumGSM8K (EM)deepseek-v4-flashunsloth30deepseek-ai/DeepSeek-V4-Flash91.1
DeepSeek-V4-FlashmediumGSM8K (EM)deepseek-v4-flashunsloth31deepseek-ai/DeepSeek-V4-Flash91.1
DeepSeek-V4-Pro-DSparkmediumGSM8K (EM)Unknowndeepseek-ai32—91.1
DeepSeek-V4-PromediumGSM8K (EM)deepseek-v4-prounsloth33deepseek-ai/DeepSeek-V4-Pro91.1
Phi-3-medium-4k-instructmediumGSM8K Chain of Thought<br>8-shotphi-3-medium-4k-instructmicrosoft34microsoft/Phi-3-medium-4k-instruct91
NVLM-D-72BlowUnknownnvlm-d-72bnvidia35nvidia/NVLM-D-72B90.8
NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16mediumGSM8Knvidia-nemotron-3-super-120b-a12b-base-bf16nvidia36nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF1690.67
Ling-2.6-flash-basemediumGSM8Kling-2-6-flashinclusionAI37inclusionAI/Ling-2.6-flash90.6
Phi-3-small-8k-instructmediumGSM8K Chain of Thought<br>8-shotphi-3-small-8k-instructmicrosoft38microsoft/Phi-3-small-8k-instruct89.6
Ling-2.6-1T-basemediumGSM8Kling-2-6-1tinclusionAI39inclusionAI/Ling-2.6-1T89.31
NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16mediumGSM8K (8-shot, acc)nvidia-nemotron-3-nano-30b-a3b-base-bf16nvidia40nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF1689.01
Nemotron-H-4B-Instruct-128KlowUnknownnemotron-h-4b-base-8knvidia41nvidia/Nemotron-H-4B-Base-8K88.93
Qwen2.5-Omni-3BmediumGSM8Kqwen2-5-omni-3bQwen42Qwen/Qwen2.5-Omni-3B88.7
Qwen2.5-Omni-7BmediumGSM8Kqwen2-5-omni-7bQwen43Qwen/Qwen2.5-Omni-7B88.7
Qwen2.5-Omni-7B-GGUFmediumGSM8Kqwen2-5-omni-7bunsloth44Qwen/Qwen2.5-Omni-7B88.7
Qwen2.5-Omni-3B-GGUFmediumGSM8Kqwen2-5-omni-3bunsloth45Qwen/Qwen2.5-Omni-3B88.7
Qwen2.5-Omni-3B-GGUFmediumGSM8Kqwen2-5-omni-3bMungert46Qwen/Qwen2.5-Omni-3B88.7
Qwen2.5-Omni-7BmediumGSM8Kqwen2-5-omni-7bunsloth47Qwen/Qwen2.5-Omni-7B88.7
Qwen2.5-Omni-7B-GGUFmediumGSM8Kqwen2-5-omni-7bMungert48Qwen/Qwen2.5-Omni-7B88.7
Qwen2.5-Omni-3BmediumGSM8Kqwen2-5-omni-3bunsloth49Qwen/Qwen2.5-Omni-3B88.7
Phi-4-mini-instructmediumGSM8K (8-shot, CoT)phi-4-mini-instructmicrosoft50microsoft/Phi-4-mini-instruct88.6
Phi-4-mini-instruct-GGUFmediumGSM8K (8-shot, CoT)phi-4-mini-instructunsloth51microsoft/Phi-4-mini-instruct88.6
Phi-4-mini-instruct-unsloth-bnb-4bitmediumGSM8K (8-shot, CoT)phi-4-mini-instructunsloth52microsoft/Phi-4-mini-instruct88.6
Phi-4-mini-instruct-bnb-4bitmediumGSM8K (8-shot, CoT)phi-4-mini-instructunsloth53microsoft/Phi-4-mini-instruct88.6
Phi-4-mini-instructmediumGSM8K (8-shot, CoT)phi-4-mini-instructunsloth54microsoft/Phi-4-mini-instruct88.6
Phi-4-mini-instruct-GGUFmediumGSM8K (8-shot, CoT)phi-4-mini-instructMungert55microsoft/Phi-4-mini-instruct88.6
NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16mediumGSM8Knvidia-nemotron-3-ultra-550b-a55b-base-bf16nvidia56nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF1688.1
internlm2-math-plus-20bhighUnknowninternlm2-math-plus-20binternlm57internlm/internlm2-math-plus-20b87.7
Phi-3-medium-128k-instructmediumGSM8K Chain of Thought<br>8-shotphi-3-medium-128k-instructmicrosoft58microsoft/Phi-3-medium-128k-instruct87.5
Phi-3-small-128k-instructmediumGSM8K Chain of Thought<br>8-shotphi-3-small-128k-instructmicrosoft59microsoft/Phi-3-small-128k-instruct87.3
Nemotron-H-8B-Base-8KlowGSM8K 8-shot CoT | MATH 4-shot CoT | MATH-Lvl 5 4-shot CoT | MATH-500 4-shot CoTnemotron-h-8b-base-8knvidia60nvidia/Nemotron-H-8B-Base-8K87.11
internlm2_5-7b-chatmediumGSM8K (0-shot CoT)internlm2-5-7b-chatinternlm61internlm/internlm2_5-7b-chat86
internlm2-math-plus-7bhighUnknowninternlm2-math-plus-7binternlm62internlm/internlm2-math-plus-7b85.8
Phi-mini-MoE-instructhighUnknownphi-mini-moe-instructmicrosoft63microsoft/Phi-mini-MoE-instruct84.89
Falcon-H1-3B-InstructmediumGSM8kfalcon-h1-3b-basetiiuae64tiiuae/Falcon-H1-3B-Base84.76
Falcon-H1-3B-Instruct-GGUFmediumGSM8kfalcon-h1-3b-basetiiuae65tiiuae/Falcon-H1-3B-Base84.76
Falcon-H1-3B-Instruct-GGUFmediumGSM8kfalcon-h1-3b-instructunsloth66tiiuae/Falcon-H1-3B-Instruct84.76
OpenMath2-Llama3.1-8BlowUnknownllama-3-1-8bnvidia67meta-llama/Llama-3.1-8B84.5
OpenMath2-Llama3.1-8B-GGUFlowUnknownllama-3-1-8bMungert68meta-llama/Llama-3.1-8B84.5
OpenMath2-Llama3.1-70BlowUnknownllama-3-1-70bnvidia69meta-llama/Llama-3.1-70B84.5
LFM2-8B-A1B-GGUFlowUnknownlfm2-8b-a1bunsloth70LiquidAI/LFM2-8B-A1B84.38
LFM2-8B-A1BlowUnknownlfm2-8b-a1bunsloth71LiquidAI/LFM2-8B-A1B84.38
glm-4-9bhighUnknownglm-4-9bzai-org72zai-org/glm-4-9b84
glm-4-9b-hfhighUnknownglm-4-9b-hfzai-org73zai-org/glm-4-9b-hf84
Falcon-H1-34B-InstructmediumGSM8kfalcon-h1-34b-basetiiuae74tiiuae/Falcon-H1-34B-Base83.62
Falcon-H1-34B-Instruct-GGUFmediumGSM8kfalcon-h1-34b-instructtiiuae75tiiuae/Falcon-H1-34B-Instruct83.62
Falcon-H1-34B-Instruct-GGUFmediumGSM8kfalcon-h1-34b-instructunsloth76tiiuae/Falcon-H1-34B-Instruct83.62
Falcon-H1-34B-Instruct-GPTQ-Int4mediumGSM8kfalcon-h1-34b-instructtiiuae77tiiuae/Falcon-H1-34B-Instruct83.62
WizardMath-7B-V1.1-GGUFlowUnknownUnknownTheBloke78WizardLM/WizardMath-7B-V1.183.2
DeepSeek-V2-Chatmedium**GSM8K**deepseek-v2-chatdeepseek-ai79deepseek-ai/DeepSeek-V2-Chat83
DeepSeek-V2medium**GSM8K**deepseek-v2deepseek-ai80deepseek-ai/DeepSeek-V283
LFM2-2.6B-GGUFhighUnknownlfm2-2-6bMungert81LiquidAI/LFM2-2.6B82.41
Falcon-H1-1.5B-Deep-InstructmediumGSM8kfalcon-h1-1-5b-deep-basetiiuae82tiiuae/Falcon-H1-1.5B-Deep-Base82.34
Falcon-H1-1.5B-Deep-Instruct-GGUFmediumGSM8kfalcon-h1-1-5b-deep-instructtiiuae83tiiuae/Falcon-H1-1.5B-Deep-Instruct82.34
Falcon-H1-1.5B-Deep-Instruct-GGUFmediumGSM8kfalcon-h1-1-5b-deep-instructunsloth84tiiuae/Falcon-H1-1.5B-Deep-Instruct82.34
Falcon-H1-1.5B-Deep-InstructmediumGSM8kfalcon-h1-1-5b-deep-instructunsloth85tiiuae/Falcon-H1-1.5B-Deep-Instruct82.34
Falcon-H1-1.5B-Deep-Instruct-GPTQ-Int4mediumGSM8kfalcon-h1-1-5b-deep-instructtiiuae86tiiuae/Falcon-H1-1.5B-Deep-Instruct82.34
Falcon-H1-7B-InstructmediumGSM8kfalcon-h1-7b-basetiiuae87tiiuae/Falcon-H1-7B-Base81.65
Falcon-H1-7B-Instruct-GPTQ-Int4mediumGSM8kfalcon-h1-7b-instructtiiuae88tiiuae/Falcon-H1-7B-Instruct81.65
Falcon-H1-7B-Instruct-GGUFmediumGSM8kfalcon-h1-7b-instructtiiuae89tiiuae/Falcon-H1-7B-Instruct81.65
Falcon-H1-7B-Instruct-GGUFmediumGSM8kfalcon-h1-7b-instructunsloth90tiiuae/Falcon-H1-7B-Instruct81.65
WizardCoder-Python-34B-V1.0-GGUFlowUnknownUnknownTheBloke91WizardLM/WizardCoder-Python-34B-V1.081.6
WizardCoder-Python-13B-V1.0-GGUFlowUnknownUnknownTheBloke92WizardLM/WizardCoder-Python-13B-V1.081.6
WizardCoder-Python-7B-V1.0-GGUFlowUnknownUnknownTheBloke93WizardLM/WizardCoder-Python-7b-V1.081.6
WizardLM-70B-V1.0-GPTQlowUnknownUnknownTheBloke94WizardLM/WizardLM-70B-V1.081.6
WizardLM-13B-V1.2-GGUFlowUnknownUnknownTheBloke95WizardLM/WizardLM-13B-V1.281.6
WizardLM-70B-V1.0-GGUFlowUnknownUnknownTheBloke96WizardLM/WizardLM-70B-V1.081.6
WizardLM-13B-V1.1-GGUFlowUnknownUnknownTheBloke97WizardLM/WizardLM-13B-V1.181.6
wizardLM-7B-GGUFlowUnknownUnknownTheBloke98WizardLM/WizardLM-7B-V1.081.6
WizardMath-70B-V1.0-GGUFhighUnknownUnknownTheBloke99WizardLM/WizardMath-70B-V1.081.6
WizardLM-30B-GGUFlowUnknownUnknownTheBloke100WizardLM/WizardLM-30B-V1.081.6
WizardCoder-Python-13B-V1.0-GPTQlowUnknownUnknownTheBloke101WizardLM/WizardCoder-Python-13B-V1.081.6
WizardLM-13B-V1.2-GPTQlowUnknownUnknownTheBloke102WizardLM/WizardLM-13B-V1.281.6
WizardLM-13B-V1.1-GPTQlowUnknownUnknownTheBloke103WizardLM/WizardLM-13B-V1.181.6
WizardCoder-Python-34B-V1.0-GPTQlowUnknownUnknownTheBloke104WizardLM/WizardCoder-Python-34B-V1.081.6
Mistral-Small-24B-Base-2501medium[GSM8K][]mistral-small-24b-base-2501mistralai105mistralai/Mistral-Small-24B-Base-250180.73
SUS-Chat-34B-GGUFhighUnknownUnknownTheBloke106SUSTech/SUS-Chat-34B80.06
OLMo-2-1124-7B-InstructlowUnknownUnknownallenai107allenai/OLMo-2-1124-7B-DPO79.7
OLMo-2-1124-13B-InstructlowUnknownolmo-2-1124-13b-instruct-rlvr2allenai108allenai/OLMo-2-1124-13B-Instruct-RLVR279.7
OLMo-2-1124-7B-SFTlowUnknownolmo2-7b-1124allenai109allenai/OLMo2-7B-112479.7
OLMo-2-1124-7B-DPOlowUnknownUnknownallenai110allenai/OLMo-2-1124-7B-SFT79.7
OLMo-2-1124-13B-SFTlowUnknownolmo2-13b-1124allenai111allenai/OLMo2-13B-112479.7
OLMo-2-1124-13B-DPOlowUnknownUnknownallenai112allenai/OLMo-2-1124-13B-SFT79.7
OLMo-2-1124-7B-Instruct-previewlowUnknownUnknownallenai113allenai/OLMo-2-1124-7B-DPO79.7
OLMo-2-1124-7B-RMlowUnknownUnknownallenai114allenai/OLMo-2-1124-7B-SFT79.7
OLMo-2-1124-7B-RM-PreviewlowUnknownUnknownallenai115allenai/OLMo-2-1124-7B-SFT79.7
OLMo-2-1124-13B-RMlowUnknownUnknownallenai116allenai/OLMo-2-1124-13B-SFT79.7
OLMo-2-1124-13B-Instruct-previewlowUnknownolmo-2-1124-13b-dpoallenai117allenai/OLMo-2-1124-13B-DPO79.7
OLMo-2-1124-7B-SFT-PreviewlowUnknownolmo2-7b-1124allenai118allenai/OLMo2-7B-112479.7
OLMo-2-1124-7B-DPO-PreviewlowUnknownUnknownallenai119allenai/OLMo-2-1124-7B-SFT79.7
Qwen2-7B-InstructmediumGSM8Kqwen2-7bQwen120Qwen/Qwen2-7B79.6
glm-4-9b-chathighUnknownglm-4-9b-chatzai-org121zai-org/glm-4-9b-chat79.6
glm-4-9b-chat-hfhighUnknownglm-4-9b-chatzai-org122THUDM/glm-4-9b-chat79.6
Qwen2-72BmediumGSM8Kqwen2-72bQwen123Qwen/Qwen2-72B79.2
Phi-tiny-MoE-instructhighUnknownphi-tiny-moe-instructmicrosoft124microsoft/Phi-tiny-MoE-instruct78.47
openchat-3.5-1210-GGUFhighBBH CoTopenchat-3-5-1210TheBloke125openchat/openchat-3.5-121077.3
openchat-3.5-1210-GGUFlowUnknownopenchat-3-5-1210TheBloke126openchat/openchat-3.5-121077.3
openchat-3.5-0106-GGUFhighBBH CoTopenchat-3-5-0106TheBloke127openchat/openchat-3.5-010677.3
openchat-3.5-0106-GGUFhighUnknownopenchat-3-5-0106TheBloke128openchat/openchat-3.5-010677.3
openchat_3.5-GGUFlowBBH CoTUnknownTheBloke129openchat/openchat_3.577.3
openchat_3.5-16k-GGUFlowUnknownUnknownTheBloke130NurtureAI/openchat_3.5-16k77.3
openchat_3.5-16k-GGUFlowBBH CoTUnknownTheBloke131NurtureAI/openchat_3.5-16k77.3
openchat-3.5-1210-GPTQhighBBH CoTopenchat-3-5-1210TheBloke132openchat/openchat-3.5-121077.3
openchat-3.5-1210-GPTQlowUnknownopenchat-3-5-1210TheBloke133openchat/openchat-3.5-121077.3
openchat_3.5-GPTQlowBBH CoTUnknownTheBloke134openchat/openchat_3.577.3
Falcon-H1-34B-BasemediumGSM8kfalcon-h1-34b-basetiiuae135tiiuae/Falcon-H1-34B-Base76.5
Qwen-72B-ChatlowUnknownqwen-72bQwen136Qwen/Qwen-72B76.4
Llama-3.1-Tulu-3-8B-SFTmedium**GSM8K (8 shot, CoT)**llama-3-1-8ballenai137meta-llama/Llama-3.1-8B76.2
Llama-3.1-Tulu-3-8Bmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-8b-dpoallenai138allenai/Llama-3.1-Tulu-3-8B-DPO76.2
Llama-3.1-Tulu-3-8B-DPOmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-8b-sftallenai139allenai/Llama-3.1-Tulu-3-8B-SFT76.2
Llama-3.1-Tulu-3-8B-RMmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-8b-sftallenai140allenai/Llama-3.1-Tulu-3-8B-SFT76.2
Llama-3.1-Tulu-3.1-8Bmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-8b-dpoallenai141allenai/Llama-3.1-Tulu-3-8B-DPO76.2
Llama-3.1-Tulu-3-70Bmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-70b-dpoallenai142allenai/Llama-3.1-Tulu-3-70B-DPO76.2
Llama-3.1-Tulu-3-70B-SFTmedium**GSM8K (8 shot, CoT)**llama-3-1-70ballenai143meta-llama/Llama-3.1-70B76.2
Llama-3.1-Tulu-3-405Bmedium**GSM8K (8 shot, CoT)**Unknownallenai144allenai/Llama-3.1-Tulu-3-405B-DPO76.2
Llama-3.1-Tulu-3-70B-DPOmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-70b-sftallenai145allenai/Llama-3.1-Tulu-3-70B-SFT76.2
Llama-3.1-Tulu-3-8B-GGUFmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-8bunsloth146allenai/Llama-3.1-Tulu-3-8B76.2
Llama-3.1-Tulu-3-405B-SFTmedium**GSM8K (8 shot, CoT)**llama-3-1-405ballenai147meta-llama/Llama-3.1-405B76.2
Llama-3.1-Tulu-3-70B-GGUFmedium**GSM8K (8 shot, CoT)**llama-3-1-tulu-3-70bunsloth148allenai/Llama-3.1-Tulu-3-70B76.2
Llama-3.1-Tulu-3-405B-DPOmedium**GSM8K (8 shot, CoT)**Unknownallenai149allenai/Llama-3.1-Tulu-3-405B-SFT76.2
UNA-ThePitbull-21.4B-v2-GGUFmediumUnknownUnknownbartowski150—75.66
Qwen-72B-Chat-Int4highUnknownqwen-72bQwen151Qwen/Qwen-72B75.3
Falcon-H1-1.5B-InstructmediumGSM8kfalcon-h1-1-5b-basetiiuae152tiiuae/Falcon-H1-1.5B-Base74.98
Falcon-H1-1.5B-Instruct-GGUFmediumGSM8kfalcon-h1-1-5b-instructtiiuae153tiiuae/Falcon-H1-1.5B-Instruct74.98
Falcon-H1-1.5B-Instruct-GGUFmediumGSM8kfalcon-h1-1-5b-instructunsloth154tiiuae/Falcon-H1-1.5B-Instruct74.98
Falcon-H1-1.5B-Instruct-GPTQ-Int4mediumGSM8kfalcon-h1-1-5b-instructtiiuae155tiiuae/Falcon-H1-1.5B-Instruct74.98
Falcon-H1-1.5B-Instruct-GPTQ-Int8mediumGSM8kfalcon-h1-1-5b-instructtiiuae156tiiuae/Falcon-H1-1.5B-Instruct74.98
internlm2_5-7bmediumGSM8Kinternlm2-5-7binternlm157internlm/internlm2_5-7b74.8
OLMo-2-0425-1BlowUnknownolmo-2-0425-1ballenai158allenai/OLMo-2-0425-1B74.3
OLMo-2-0325-32B-InstructlowUnknownUnknownallenai159allenai/OLMo-2-0325-32B-DPO74.3
OLMo-2-0325-32B-Instruct-GGUFlowUnknownolmo-2-0325-32b-instructunsloth160allenai/OLMo-2-0325-32B-Instruct74.3
OLMo-2-0325-32B-SFTlowUnknownolmo-2-0325-32ballenai161allenai/OLMo-2-0325-32B74.3
OLMo-2-0325-32B-DPOlowUnknownUnknownallenai162allenai/OLMo-2-0325-32B-SFT74.3
OLMo-2-0325-32B-InstructlowUnknownolmo-2-0325-32b-instructunsloth163allenai/OLMo-2-0325-32B-Instruct74.3
Qwen-72B-Chat-Int8highUnknownqwen-72bQwen164Qwen/Qwen-72B73.5
Falcon-H1-7B-BasemediumGSM8kfalcon-h1-7b-basetiiuae165tiiuae/Falcon-H1-7B-Base73.46
AceInstruct-7BmediumGSM8Kaceinstruct-7bnvidia166nvidia/AceInstruct-7B73.2
AceInstruct-1.5BmediumGSM8Kaceinstruct-1-5bnvidia167nvidia/AceInstruct-1.5B73.2
AceInstruct-72BmediumGSM8Kaceinstruct-72bnvidia168nvidia/AceInstruct-72B73.2
AceInstruct-1.5B-GGUFmediumGSM8Kaceinstruct-1-5bMungert169nvidia/AceInstruct-1.5B73.2
NeuralDaredevil-7BmediumGSM8k (5-shot)daredevil-7bmlabonne170mlabonne/Daredevil-7B73.16
Daredevil-7BmediumGSM8k (5-shot)mistral-7b-v0-1mlabonne171mistralai/Mistral-7B-v0.172.93
OLMoE-1B-7B-0125-Instructmedium**GSM8K**olmoe-1b-7b-0125-dpoallenai172allenai/OLMoE-1B-7B-0125-DPO72.4
OLMoE-1B-7B-0125-DPOmedium**GSM8K**Unknownallenai173allenai/OLMoE-1B-7B-0125-SFT72.4
OLMoE-1B-7B-0125-SFTmedium**GSM8K**olmoe-1b-7b-0125allenai174allenai/OLMoE-1B-7B-012572.4
supermario-v2-GGUFmediumGSM8K (5-shot)supermario-v2TheBloke175janhq/supermario-v272.18
UNA-TheBeagle-7B-v1-GGUFmediumUnknownuna-thebeagle-7b-v1TheBloke176fblgit/UNA-TheBeagle-7b-v172.1
Seraph-7B-GGUFmediumGSM8K (5-shot)seraph-7bTheBloke177Weyaxi/Seraph-7B71.87
Yi-34B-Chat-GGUFhighUnknownyi-34b-chatTheBloke17801-ai/Yi-34B-Chat71.65
Yi-34B-Chat-AWQhighUnknownyi-34b-chatTheBloke17901-ai/Yi-34B-Chat71.65
Beagle14-7BmediumGSM8k (5-shot)una-thebeagle-7b-v1mlabonne180fblgit/UNA-TheBeagle-7b-v171.42
Darewin-7BmediumGSM8k (5-shot)neural-chat-7b-v3-3mlabonne181Intel/neural-chat-7b-v3-371.04
Marcoro14-7B-slerpmediumGSM8k (5-shot)Unknownmlabonne182AIDC-ai-business/Marcoroni-7B-v370.89
internlm2-chat-7bmediumGSM8Kinternlm2-chat-7binternlm183internlm/internlm2-chat-7b70.8
internlm2-7bmediumGSM8KUnknowninternlm184internlm/internlm2-7b70.8
internlm2-chat-20bmediumGSM8Kinternlm2-chat-20binternlm185internlm/internlm2-chat-20b70.8
internlm2-20bmediumGSM8KUnknowninternlm186internlm/internlm2-20b70.8
internlm2-base-7bmediumGSM8KUnknowninternlm187internlm/internlm2-base-7b70.8
internlm2-base-20bmediumGSM8KUnknowninternlm188internlm/internlm2-base-20b70.8
internlm2-chat-7b-sftmediumGSM8Kinternlm2-chat-7b-sftinternlm189internlm/internlm2-chat-7b-sft70.8
internlm2-chat-20b-sftmediumGSM8Kinternlm2-chat-20b-sftinternlm190internlm/internlm2-chat-20b-sft70.8
c4ai-command-r-plus-GPTQlowUnknownUnknownalpindale191—70.7
DiscoLM-70B-GGUFmediumGSM8Kdiscolm-70bTheBloke192DiscoResearch/DiscoLM-70b70.6
NexoNimbus-7B-GGUFmediumUnknownnexonimbus-7bTheBloke193abideen/NexoNimbus-7B70.35
OmniBeagle-7BmediumGSM8k (5-shot)beaglesempra-7bmlabonne194shadowml/BeagleSempra-7B70.05
go-bruins-GGUFlowUnknownUnknownTheBloke195rwitz/go-bruins69.9
NeuralPipe-7B-slerpmediumGSM8k (5-shot)mistral-ft-optimized-1218mlabonne196OpenPipe/mistral-ft-optimized-121869.75
go-bruins-v2-GGUFlowUnknownUnknownTheBloke197rwitz/go-bruins-v269.67
NeuralPipe-7B-tiesmediumGSM8k (5-shot)mistral-ft-optimized-1218mlabonne198OpenPipe/mistral-ft-optimized-121869.52
Monarch-7BmediumGSM8k (5-shot)omnitruthybeagle-7b-v0mlabonne199mlabonne/OmniTruthyBeagle-7B-v069.07
TenyxChat-7B-v1-GGUFhighUnknowntenyxchat-7b-v1TheBloke200tenyx/TenyxChat-7B-v169
Falcon-H1-1.5B-Deep-BasemediumGSM8kfalcon-h1-1-5b-deep-basetiiuae201tiiuae/Falcon-H1-1.5B-Deep-Base68.69
gemma-2-9b-itmedium[GSM8K][]gemma-2-9bgoogle202google/gemma-2-9b68.6
gemma-2-27b-itmedium[GSM8K][]gemma-2-27bgoogle203google/gemma-2-27b68.6
gemma-2-9bmedium[GSM8K][]gemma-2-9bgoogle204google/gemma-2-9b68.6
gemma-2-27bmedium[GSM8K][]gemma-2-27bgoogle205google/gemma-2-27b68.6
Falcon-H1-0.5B-InstructmediumGSM8kfalcon-h1-0-5b-basetiiuae206tiiuae/Falcon-H1-0.5B-Base68.39
Falcon-H1-0.5B-Instruct-GGUFmediumGSM8kfalcon-h1-0-5b-basetiiuae207tiiuae/Falcon-H1-0.5B-Base68.39
Falcon-H1-0.5B-Instruct-GGUFmediumGSM8kfalcon-h1-0-5b-instructunsloth208tiiuae/Falcon-H1-0.5B-Instruct68.39
Falcon-H1-3B-BasemediumGSM8kfalcon-h1-3b-basetiiuae209tiiuae/Falcon-H1-3B-Base68.31
OpenHermes-2.5-neural-chat-v3-3-Slerp-GGUFmediumGSM8K (5-shot)openhermes-2-5-neural-chat-v3-3-slerpTheBloke210Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp67.78
NeuralDarewin-7BmediumGSM8k (5-shot)mistral-7b-v0-1mlabonne211mistralai/Mistral-7B-v0.166.72
UNAversal-8x7B-v1beta-GGUFmediumUnknownunaversal-8x7b-v1betaTheBloke212fblgit/UNAversal-8x7B-v1beta66.03
Qwen2-57B-A14B-InstructmediumGSM8Kqwen2-57b-a14bQwen213Qwen/Qwen2-57B-A14B65.7
CarbonVillain-en-10.7B-v4-GGUFmediumGSM8K (5-shot)carbonvillain-en-10-7b-v4TheBloke214jeonsworld/CarbonVillain-en-10.7B-v465.58
Optimus-7B-GGUFmediumGSM8K (5-shot)optimus-7bTheBloke215Q-bert/Optimus-7B65.5
LUNA-SOLARkrautLM-Instruct-GGUFmediumUnknownluna-solarkrautlm-instructTheBloke216fblgit/LUNA-SOLARkrautLM-Instruct64.67
LFM2.5-1.2B-Thinking-GGUFlowUnknownlfm2-5-1-2b-thinkingunsloth217LiquidAI/LFM2.5-1.2B-Thinking64.52
LFM2.5-1.2B-Thinking-GGUFlowUnknownlfm2-5-1-2b-baseMungert218LiquidAI/LFM2.5-1.2B-Base64.52
SauerkrautLM-SOLAR-Instruct-GGUFmediumGSM8K (5-shot)sauerkrautlm-solar-instructTheBloke219VAGOsolutions/SauerkrautLM-SOLAR-Instruct64.14
WizardMath-13B-V1.0-GGUFhighUnknownUnknownTheBloke220WizardLM/WizardMath-13B-V1.063.9
DiscoLM-70B-GGUFmediumGSM8k (5-shot)discolm-70bTheBloke221DiscoResearch/DiscoLM-70b63.68
UNA-ThePitbull-21.4B-v2-GGUFmediumGSM8k (5-shot)Unknownbartowski222—63.53
gemma-3-270mmedium[GSM8K][]gemma-3-270mgoogle223google/gemma-3-270m62.8
gemma-3-270m-itmedium[GSM8K][]gemma-3-270mgoogle224google/gemma-3-270m62.8
gemma-3-270m-it-GGUFmedium[GSM8K][]gemma-3-270m-itunsloth225google/gemma-3-270m-it62.8
gemma-3-270m-itmedium[GSM8K][]gemma-3-270m-itunsloth226google/gemma-3-270m-it62.8
gemma-3-270m-it-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-270m-itunsloth227google/gemma-3-270m-it62.8
gemma-3-270m-it-qat-GGUFmedium[GSM8K][]gemma-3-270m-it-qat-q4-0-unquantizedunsloth228google/gemma-3-270m-it-qat-q4_0-unquantized62.8
gemma-3-270mmedium[GSM8K][]gemma-3-270munsloth229google/gemma-3-270m62.8
gemma-3-270m-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-270m-itunsloth230google/gemma-3-270m-it62.8
gemma-3-270m-it-qat-q4_0-unquantizedmedium[GSM8K][]gemma-3-270m-itgoogle231google/gemma-3-270m-it62.8
gemma-3-270m-it-bnb-4bitmedium[GSM8K][]gemma-3-270m-itunsloth232google/gemma-3-270m-it62.8
gemma-3-270m-it-qatmedium[GSM8K][]gemma-3-270m-it-qat-q4-0-unquantizedunsloth233google/gemma-3-270m-it-qat-q4_0-unquantized62.8
gemma-3-270m-bnb-4bitmedium[GSM8K][]gemma-3-270munsloth234google/gemma-3-270m62.8
gemma-3-270m-qat-q4_0-unquantizedmedium[GSM8K][]gemma-3-270mgoogle235google/gemma-3-270m62.8
gemma-3-270m-it-GGUFmedium[GSM8K][]gemma-3-270mMungert236google/gemma-3-270m62.8
gemma-3-270m-it-torchao-FP8medium[GSM8K][]gemma-3-270m-itunsloth237google/gemma-3-270m-it62.8
smol-7B-GGUFlowUnknownsmol-7bTheBloke238rishiraj/smol-7b62.32
neural-chat-7B-v3-3-GGUFmediumGSM8K (5-shot)neural-chat-7b-v3-3TheBloke239Intel/neural-chat-7b-v3-361.11
neural-chat-7B-v3-3-GPTQmediumGSM8K (5-shot)neural-chat-7b-v3-3TheBloke240Intel/neural-chat-7b-v3-361.11
PlatYi-34B-Llama-Q-v3-GGUFhighUnknownplatyi-34b-llama-q-v3TheBloke241kyujinpy/PlatYi-34B-Llama-Q-v360.42
Falcon-H1-0.5B-BasemediumGSM8kfalcon-h1-0-5b-basetiiuae242tiiuae/Falcon-H1-0.5B-Base60.2
Qwen-14B-ChatlowUnknownqwen-14b-chatQwen243Qwen/Qwen-14B-Chat60.1
Qwen-14B-Chat-GPTQlowUnknownqwen-14b-chatTheBloke244Qwen/Qwen-14B-Chat60.1
Qwen-14B-Chat-AWQlowUnknownqwen-14b-chatTheBloke245Qwen/Qwen-14B-Chat60.1
Qwen-14B-Chat-Int8highUnknownqwen-14bQwen246Qwen/Qwen-14B60
Qwen2-57B-A14BmediumGSM8Kqwen2-57b-a14bQwen247Qwen/Qwen2-57B-A14B59.9
Qwen-14B-Chat-Int4highUnknownqwen-14bQwen248Qwen/Qwen-14B59.8
LFM2-1.2B-GGUFhighUnknownlfm2-1-2bunsloth249LiquidAI/LFM2-1.2B58.3
LFM2-1.2B-unsloth-bnb-4bithighUnknownlfm2-1-2bunsloth250LiquidAI/LFM2-1.2B58.3
LFM2-1.2BhighUnknownlfm2-1-2bunsloth251LiquidAI/LFM2-1.2B58.3
Nanbeige-16B-Base-GGUFhighUnknownUnknownTheBloke252Nanbeige/Nanbeige-16B-Base57.62
Qwen2-0.5BmediumGSM8Kqwen2-0-5bQwen253Qwen/Qwen2-0.5B57.2
Qwen2-1.5BmediumGSM8Kqwen2-1-5bQwen254Qwen/Qwen2-1.5B57.2
llama-3-tulu-2-8blowGSM8k 8-shot cot | BBH 3-shot cotmeta-llama-3-8ballenai255meta-llama/Meta-Llama-3-8B56.5
llama-3-tulu-2-70blowGSM8k 8-shot cot | BBH 3-shot cotmeta-llama-3-70ballenai256meta-llama/Meta-Llama-3-70B56.5
NeuralHermes-2.5-Mistral-7B-lasermediumGSM8k (5-shot)openhermes-2-5-mistral-7bmlabonne257teknium/OpenHermes-2.5-Mistral-7B55.72
Hunyuan-7B-Instruct-GGUFmediumGSM8Khunyuan-7b-pretrainMungert258tencent/Hunyuan-7B-Pretrain55.64
una-xaberius-34b-v1beta-GGUFlowUnknownuna-xaberius-34b-v1betaTheBloke259fblgit/una-xaberius-34b-v1beta55.12
WizardMath-7B-V1.0-GGUFhighUnknownUnknownTheBloke260WizardLM/WizardMath-7b-V1.054.9
falcon-11BmediumGSM8k-5shotsfalcon-11btiiuae261tiiuae/falcon-11B53.83
internlm2-math-plus-1_8blowUnknowninternlm2-math-plus-1-8binternlm262internlm/internlm2-math-plus-1_8b53.8
falcon-mamba-7blowUnknownfalcon-mamba-7btiiuae263tiiuae/falcon-mamba-7b52.54
falcon-mamba-7b-instructlowUnknownfalcon-mamba-7btiiuae264tiiuae/falcon-mamba-7b52.54
falcon-mamba-7b-instruct-Q4_K_M-GGUFlowUnknownfalcon-mamba-7b-instructtiiuae265tiiuae/falcon-mamba-7b-instruct52.54
falcon-mamba-7b-instruct-4bitlowUnknownfalcon-mamba-7b-instructtiiuae266tiiuae/falcon-mamba-7b-instruct52.54
falcon-mamba-7b-Q8_0-GGUFlowUnknownfalcon-mamba-7btiiuae267tiiuae/falcon-mamba-7b52.54
falcon-mamba-7b-F16-GGUFlowUnknownfalcon-mamba-7btiiuae268tiiuae/falcon-mamba-7b52.54
falcon-mamba-7b-4bitlowUnknownfalcon-mamba-7btiiuae269tiiuae/falcon-mamba-7b52.54
Qwen2-7BmediumGSM8Kqwen2-7bQwen270Qwen/Qwen2-7B52.2
Falcon-H1-1.5B-BasemediumGSM8kfalcon-h1-1-5b-basetiiuae271tiiuae/Falcon-H1-1.5B-Base52.01
Qwen-7B-ChatlowUnknownqwen-7b-chatQwen272Qwen/Qwen-7B-Chat50.3
Qwen-7B-Chat-GPTQlowUnknownqwen-7b-chatTheBloke273Qwen/Qwen-7B-Chat50.3
Qwen-7B-Chat-AWQlowUnknownqwen-7b-chatTheBloke274Qwen/Qwen-7B-Chat50.3
Qwen-7B-Chat-Int4highUnknownqwen-7bQwen275Qwen/Qwen-7B49.7
juanako-7B-UNA-GGUFmediumUnknownjuanako-7b-unaTheBloke276fblgit/juanako-7b-UNA48.98
bagel-dpo-7B-v0.1-GGUFlowUnknownbagel-dpo-7b-v0-1TheBloke277jondurbin/bagel-dpo-7b-v0.148.52
Qwen-7B-Chat-Int8highUnknownqwen-7bQwen278Qwen/Qwen-7B48.3
LFM2-700MhighUnknownlfm2-700munsloth279LiquidAI/LFM2-700M46.4
LFM2-700M-GGUFhighUnknownlfm2-700munsloth280LiquidAI/LFM2-700M46.4
juanako-7B-v1-GGUFmediumUnknownjuanako-7b-v1TheBloke281fblgit/juanako-7b-v145.56
stablelm-zephyr-3b-GGUFmediumGSM8K (5-shot)stablelm-zephyr-3bTheBloke282stabilityai/stablelm-zephyr-3b42.3
gemma-3-1b-itmedium[GSM8K][]gemma-3-1b-ptgoogle283google/gemma-3-1b-pt38.4
gemma-3-4b-itmedium[GSM8K][]gemma-3-4b-ptgoogle284google/gemma-3-4b-pt38.4
gemma-3-12b-itmedium[GSM8K][]gemma-3-12b-ptgoogle285google/gemma-3-12b-pt38.4
gemma-3-27b-itmedium[GSM8K][]gemma-3-27b-ptgoogle286google/gemma-3-27b-pt38.4
gemma-3-4b-itmedium[GSM8K][]gemma-3-4b-ptunsloth287google/gemma-3-4b-it38.4
gemma-3-1b-it-GGUFmedium[GSM8K][]gemma-3-1b-ptggml-org288google/gemma-3-1b-it38.4
gemma-3-12b-it-qat-q4_0-unquantizedmedium[GSM8K][]gemma-3-12b-ptgoogle289google/gemma-3-12b-it38.4
gemma-3-1b-itmedium[GSM8K][]gemma-3-1b-ptunsloth290google/gemma-3-1b-it38.4
gemma-3-12b-it-GGUFmedium[GSM8K][]gemma-3-12b-ptunsloth291google/gemma-3-12b-it38.4
gemma-3-4b-ptmedium[GSM8K][]gemma-3-4b-ptgoogle292google/gemma-3-4b-pt38.4
gemma-3-12b-it-qat-GGUFmedium[GSM8K][]gemma-3-12b-it-qat-q4-0-unquantizedunsloth293google/gemma-3-12b-it-qat-q4_0-unquantized38.4
gemma-3-27b-itmedium[GSM8K][]gemma-3-27b-itunsloth294google/gemma-3-27b-it38.4
gemma-3-1b-ptmedium[GSM8K][]gemma-3-1b-ptgoogle295google/gemma-3-1b-pt38.4
gemma-3-4b-it-GGUFmedium[GSM8K][]gemma-3-4b-ptggml-org296google/gemma-3-4b-it38.4
gemma-3-4b-it-GGUFmedium[GSM8K][]gemma-3-4b-ptunsloth297google/gemma-3-4b-it38.4
gemma-3-1b-it-GGUFmedium[GSM8K][]gemma-3-1b-ptunsloth298google/gemma-3-1b-it38.4
gemma-3-12b-ptmedium[GSM8K][]Unknowngoogle299google/gemma-3-12b38.4
gemma-3-12b-it-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-12b-ptunsloth300google/gemma-3-12b-it38.4
gemma-3-4b-it-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-4b-ptunsloth301google/gemma-3-4b-it38.4
gemma-3-12b-itmedium[GSM8K][]gemma-3-12b-ptunsloth302google/gemma-3-12b-pt38.4
gemma-3-27b-it-GGUFmedium[GSM8K][]gemma-3-27b-itunsloth303google/gemma-3-27b-it38.4
gemma-3-1b-it-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-1b-ptunsloth304google/gemma-3-1b-it38.4
gemma-3-4b-it-bnb-4bitmedium[GSM8K][]gemma-3-4b-ptunsloth305google/gemma-3-4b-it38.4
gemma-3-4b-ptmedium[GSM8K][]gemma-3-4b-ptunsloth306google/gemma-3-4b-pt38.4
gemma-3-27b-ptmedium[GSM8K][]gemma-3-27b-ptgoogle307google/gemma-3-27b-pt38.4
gemma-3-12b-it-bnb-4bitmedium[GSM8K][]gemma-3-12b-ptunsloth308google/gemma-3-12b-it38.4
gemma-3-27b-it-GGUFmedium[GSM8K][]gemma-3-27b-itggml-org309google/gemma-3-27b-it38.4
gemma-3-12b-ptmedium[GSM8K][]gemma-3-12b-ptunsloth310google/gemma-3-12b-pt38.4
gemma-3-27b-it-bnb-4bitmedium[GSM8K][]gemma-3-27b-itunsloth311google/gemma-3-27b-it38.4
gemma-3-27b-it-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-27b-itunsloth312google/gemma-3-27b-it38.4
gemma-3-1b-ptmedium[GSM8K][]gemma-3-1b-ptunsloth313google/gemma-3-1b-pt38.4
gemma-3-12b-it-GGUFmedium[GSM8K][]gemma-3-12b-ptggml-org314google/gemma-3-12b-it38.4
gemma-3-4b-it-qat-GGUFmedium[GSM8K][]gemma-3-4b-it-qat-q4-0-unquantizedunsloth315google/gemma-3-4b-it-qat-q4_0-unquantized38.4
gemma-3-12b-it-qat-bnb-4bitmedium[GSM8K][]gemma-3-12b-it-qat-q4-0-unquantizedunsloth316google/gemma-3-12b-it-qat-q4_0-unquantized38.4
gemma-3-12b-it-qat-int4-GGUFmedium[GSM8K][]gemma-3-12b-it-qat-int4-unquantizedunsloth317google/gemma-3-12b-it-qat-int4-unquantized38.4
gemma-3-4b-it-qat-q4_0-ggufmedium[GSM8K][]gemma-3-4b-ptgoogle318google/gemma-3-4b-it38.4
gemma-3-4b-it-qat-q4_0-unquantizedmedium[GSM8K][]gemma-3-4b-ptgoogle319google/gemma-3-4b-it38.4
gemma-3-4b-pt-bnb-4bitmedium[GSM8K][]gemma-3-4b-ptunsloth320google/gemma-3-4b-pt38.4
gemma-3-27b-it-qat-GGUFmedium[GSM8K][]gemma-3-27b-it-qat-q4-0-unquantizedunsloth321google/gemma-3-27b-it-qat-q4_0-unquantized38.4
gemma-3-12b-it-qat-q4_0-ggufmedium[GSM8K][]gemma-3-12b-ptgoogle322google/gemma-3-12b-it38.4
gemma-3-1b-it-bnb-4bitmedium[GSM8K][]gemma-3-1b-ptunsloth323google/gemma-3-1b-it38.4
gemma-3-1b-it-qat-q4_0-ggufmedium[GSM8K][]gemma-3-1b-ptgoogle324google/gemma-3-1b-it38.4
gemma-3-4b-pt-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-4b-ptunsloth325google/gemma-3-4b-pt38.4
gemma-3-12b-it-qatmedium[GSM8K][]gemma-3-12b-it-qat-q4-0-unquantizedunsloth326google/gemma-3-12b-it-qat-q4_0-unquantized38.4
gemma-3-1b-pt-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-1b-ptunsloth327google/gemma-3-1b-pt38.4
gemma-3-4b-it-FP8-Dynamicmedium[GSM8K][]gemma-3-4b-ptunsloth328google/gemma-3-4b-it38.4
gemma-3-12b-pt-bnb-4bitmedium[GSM8K][]gemma-3-12b-ptunsloth329google/gemma-3-12b-pt38.4
gemma-3-12b-it-qat-int4-unquantizedmedium[GSM8K][]gemma-3-12b-ptgoogle330google/gemma-3-12b-it38.4
gemma-3-27b-it-GGUFmedium[GSM8K][]gemma-3-27b-ptMungert331google/gemma-3-27b-pt38.4
gemma-3-27b-it-qat-q4_0-unquantizedmedium[GSM8K][]gemma-3-27b-itgoogle332google/gemma-3-27b-it38.4
gemma-3-12b-pt-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-12b-ptunsloth333google/gemma-3-12b-pt38.4
gemma-3-27b-it-qat-q4_0-ggufmedium[GSM8K][]gemma-3-27b-itgoogle334google/gemma-3-27b-it38.4
gemma-3-27b-it-qat-q4_0-GGUFmedium[GSM8K][]gemma-3-27b-itMungert335google/gemma-3-27b-it38.4
gemma-3-4b-it-qat-bnb-4bitmedium[GSM8K][]gemma-3-4b-it-qat-q4-0-unquantizedunsloth336google/gemma-3-4b-it-qat-q4_0-unquantized38.4
gemma-3-1b-pt-bnb-4bitmedium[GSM8K][]gemma-3-1b-ptunsloth337google/gemma-3-1b-pt38.4
gemma-3-27b-ptmedium[GSM8K][]gemma-3-27b-ptunsloth338google/gemma-3-27b-pt38.4
gemma-3-12b-it-FP8-Dynamicmedium[GSM8K][]gemma-3-12b-ptunsloth339google/gemma-3-12b-pt38.4
gemma-3-1b-it-qat-int4-unquantizedmedium[GSM8K][]gemma-3-1b-ptgoogle340google/gemma-3-1b-it38.4
gemma-3-27b-pt-bnb-4bitmedium[GSM8K][]gemma-3-27b-ptunsloth341google/gemma-3-27b-pt38.4
gemma-3-12b-it-qat-unsloth-bnb-4bitmedium[GSM8K][]gemma-3-12b-it-qat-q4-0-unquantizedunsloth342google/gemma-3-12b-it-qat-q4_0-unquantized38.4
gemma-3-12b-pt-qat-q4_0-ggufmedium[GSM8K][]gemma-3-12b-ptgoogle343google/gemma-3-12b-pt38.4
gemma-3-4b-it-qatmedium[GSM8K][]gemma-3-4b-it-qat-q4-0-unquantizedunsloth344google/gemma-3-4b-it-qat-q4_0-unquantized38.4
gemma-3-1b-it-qat-q4_0-unquantizedmedium[GSM8K][]gemma-3-1b-ptgoogle345google/gemma-3-1b-it38.4
gemma-3-1b-it-qatmedium[GSM8K][]gemma-3-1b-it-qat-q4-0-unquantizedunsloth346google/gemma-3-1b-it-qat-q4_0-unquantized38.4
gemma-3-27b-it-qatmedium[GSM8K][]gemma-3-27b-it-qat-q4-0-unquantizedunsloth347google/gemma-3-27b-it-qat-q4_0-unquantized38.4
gemma-3-4b-pt-qat-q4_0-ggufmedium[GSM8K][]gemma-3-4b-ptgoogle348google/gemma-3-4b-pt38.4
bitnet-b1.58-2B-4T-ggufmediumGSM8Kbitnet-b1-58-2b-4t-bf16microsoft349microsoft/bitnet-b1.58-2B-4T-bf1638.21
bitnet-b1.58-2B-4TmediumGSM8Kbitnet-b1-58-2b-4tmicrosoft350microsoft/bitnet-b1.58-2B-4T38.21
bitnet-b1.58-2B-4T-bf16mediumGSM8Kbitnet-b1-58-2b-4t-bf16microsoft351microsoft/bitnet-b1.58-2B-4T-bf1638.21
rocket-3B-GGUFmediumGSM8K (5-shot)rocket-3bTheBloke352pansophic/rocket-3B37.91
una-cybertron-7B-v2-GGUFlowUnknownuna-cybertron-7b-v2-bf16TheBloke353fblgit/una-cybertron-7b-v2-bf1637.83
speechless-mistral-moloras-7B-GGUFmediumGSM8Kspeechless-mistral-moloras-7bTheBloke354uukuguy/speechless-mistral-moloras-7b37.68
llemma_7b-GGUFhighUnknownUnknownTheBloke355EleutherAI/llemma_7b36.4
llemma_34b-GGUFhighUnknownUnknownTheBloke356EleutherAI/llemma_34b36.4
rho-math-1b-v0.1lowUnknownrho-math-1b-v0-1microsoft357microsoft/rho-math-1b-v0.136.1
rho-math-7b-interpreter-v0.1lowUnknownrho-math-7b-interpreter-v0-1microsoft358microsoft/rho-math-7b-interpreter-v0.136.1
rho-math-7b-v0.1lowUnknownrho-math-7b-v0-1microsoft359microsoft/rho-math-7b-v0.136.1
rho-math-1b-interpreter-v0.1lowUnknownrho-math-1b-interpreter-v0-1microsoft360microsoft/rho-math-1b-interpreter-v0.136.1
internlm-chat-7bmediumGSM8KUnknowninternlm361internlm/internlm-chat-7b34.5
internlm-7bmediumGSM8KUnknowninternlm362internlm/internlm-7b34.5
Qwen-1_8B-Chat-Int8highUnknownqwen-1-8bQwen363Qwen/Qwen-1_8B33
Ministral-8B-Instruct-2410lowUnknownministral-8b-instruct-2410mistralai364mistralai/Ministral-8B-Instruct-241032
internlm2-chat-1_8bmediumGSM8Kinternlm2-chat-1-8binternlm365internlm/internlm2-chat-1_8b31.2
internlm2-1_8bmediumGSM8KUnknowninternlm366internlm/internlm2-1_8b31.2
Qwen-1_8B-Chat-Int4highUnknownqwen-1-8bQwen367Qwen/Qwen-1_8B31.2
internlm2-chat-1_8b-sftmediumGSM8Kinternlm2-chat-1-8b-sftinternlm368internlm/internlm2-chat-1_8b-sft31.2
SmolLM2-1.7B-Instruct-GGUFmediumGSM8K (5-shot)smollm2-1-7bMungert369HuggingFaceTB/SmolLM2-1.7B31
LFM2-350MhighUnknownlfm2-350munsloth370LiquidAI/LFM2-350M30.1
LFM2-350M-GGUFhighUnknownlfm2-350munsloth371LiquidAI/LFM2-350M30.1
LFM2-350M-unsloth-bnb-4bithighUnknownlfm2-350munsloth372LiquidAI/LFM2-350M30.1
digital-socrates-13bmediumGSM8k (5-shot)Unknownallenai373allenai/digital-socrates-13b29.49
OLMo-2-1124-7BlowUnknownolmo-2-1124-7ballenai374allenai/OLMo-2-1124-7B28.1
OLMo-2-1124-13BlowUnknownolmo-2-1124-13ballenai375allenai/OLMo-2-1124-13B28.1
OLMo-2-0325-32BlowUnknownolmo-2-0325-32ballenai376allenai/OLMo-2-0325-32B28.1
koOpenChat-sft-GGUFmediumGSM8K (5-shot)UnknownTheBloke377maywell/koOpenChat-sft24.18
gemma-2-2b-itmedium[GSM8K][]gemma-2-2bgoogle378google/gemma-2-2b23.9
gemma-2-2bmedium[GSM8K][]gemma-2-2bgoogle379google/gemma-2-2b23.9
Synatra-7B-v0.3-dpo-GGUFmediumGSM8K (5-shot)UnknownTheBloke380maywell/Synatra-7B-v0.3-dpo23.73
speechless-mistral-dolphin-orca-platypus-samantha-7B-GGUFmediumGSM8Kspeechless-mistral-dolphin-orca-platypus-samantha-7bTheBloke381uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7b21.38
Synatra-7B-v0.3-RP-GGUFmediumGSM8K (5-shot)UnknownTheBloke382maywell/Synatra-7B-v0.3-RP21.15
loyal-piano-m7-GGUFlowUnknownloyal-piano-m7TheBloke383chargoddard/loyal-piano-m720.7
speechless-mistral-7B-dare-0.85-GGUFlowUnknownspeechless-mistral-7b-dare-0-85TheBloke384speechlessai/speechless-mistral-7b-dare-0.8519.56
SynthIA-7B-v1.3-dare-0.85-GGUFlowUnknownUnknownTheBloke385uukuguy/SynthIA-7B-v1.3-dare-0.8519.56
airoboros-m-7B-3.1.2-dare-0.85-GGUFlowUnknownUnknownTheBloke386uukuguy/airoboros-m-7b-3.1.2-dare-0.8519.56
CollectiveCognition-v1.1-Mistral-7B-dare-0.85-GGUFlowUnknownUnknownTheBloke387uukuguy/CollectiveCognition-v1.1-Mistral-7B-dare-0.8519.56
Synatra-V0.1-7B-Instruct-GGUFmediumGSM8K (5-shot)UnknownTheBloke388maywell/Synatra-V0.1-7B-Instruct19.41
Darewin-7B-v2mediumGSM8k (5-shot)mistral-ft-optimized-1227mlabonne389OpenPipe/mistral-ft-optimized-122719.18
Dr_Samantha-7B-GGUFlowUnknowndr-samantha-7bTheBloke390sethuiyer/Dr_Samantha-7b18.8
neural-chat-7B-v3-1-GGUFlowUnknownneural-chat-7b-v3-1TheBloke391Intel/neural-chat-7b-v3-118.12
digital-socrates-7bmediumGSM8k (5-shot)Unknownallenai392allenai/digital-socrates-7b17.89
Skywork-13B-base-GGUFlowUnknownUnknownTheBloke393Skywork/Skywork-13B-base17.8
gemma-1.1-2b-itmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-1-1-2b-itgoogle394google/gemma-1.1-2b-it17.7
gemma-2bmedium[GSM8K](https://arxiv.org/abs/2110.14168)Unknowngoogle395google/gemma-2b-it-pytorch17.7
gemma-2b-itmedium[GSM8K](https://arxiv.org/abs/2110.14168)Unknowngoogle396google/gemma-2b-it-pytorch17.7
gemma-7bmedium[GSM8K](https://arxiv.org/abs/2110.14168)Unknowngoogle397google/gemma-7b-it-quant-pytorch17.7
gemma-7b-itmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-7bgoogle398google/gemma-7b17.7
gemma-1.1-7b-itmedium[GSM8K](https://arxiv.org/abs/2110.14168)gemma-1-1-7b-itgoogle399google/gemma-1.1-7b-it17.7
gemma-2b-AWQmedium[GSM8K](https://arxiv.org/abs/2110.14168)Unknowngoogle400google/gemma-2b-it-pytorch17.7
gemma-7bmedium[GSM8K](https://arxiv.org/abs/2110.14168)Unknownalpindale401google/gemma-7b-it-quant-pytorch17.7
gemma-2bmedium[GSM8K](https://arxiv.org/abs/2110.14168)Unknownalpindale402google/gemma-2b-it-pytorch17.7
gemma-7b-AWQmedium[GSM8K](https://arxiv.org/abs/2110.14168)Unknowngoogle403google/gemma-7b-it-quant-pytorch17.7
gemma-7b-itmedium[GSM8K](https://arxiv.org/abs/2110.14168)Unknownalpindale404google/gemma-7b-it-quant-pytorch17.7
gemma-7b-GGUFmedium[GSM8K](https://arxiv.org/abs/2110.14168)Unknowngoogle405google/gemma-7b-it-quant-pytorch17.7
DeepSeek-V2-Lite-Chatmedium**GSM8K**deepseek-v2-lite-chatdeepseek-ai406deepseek-ai/DeepSeek-V2-Lite-Chat17.4
DeepSeek-V2-Litemedium**GSM8K**deepseek-v2-litedeepseek-ai407deepseek-ai/DeepSeek-V2-Lite17.4
Qwen-72BlowUnknownqwen-72bQwen408Qwen/Qwen-72B16.7
Qwen-7BlowUnknownqwen-7bQwen409Qwen/Qwen-7B16.7
Qwen-14BlowUnknownqwen-14bQwen410Qwen/Qwen-14B16.7
notus-7B-v1-GGUFlowUnknownnotus-7b-v1TheBloke411argilla/notus-7b-v112.74
notus-7B-v1-AWQlowUnknownnotus-7b-v1TheBloke412argilla/notus-7b-v112.74
internlm2-math-7blowUnknowninternlm2-math-7binternlm413internlm/internlm2-math-7b11.8
internlm2-math-base-7blowUnknowninternlm2-math-base-7binternlm414internlm/internlm2-math-base-7b11.8
internlm2-math-20blowUnknowninternlm2-math-20binternlm415internlm/internlm2-math-20b11.8
internlm2-math-base-20blowUnknowninternlm2-math-base-20binternlm416internlm/internlm2-math-base-20b11.8
Qwen2-1.5B-InstructmediumGSM8Kqwen2-1-5b-instructQwen417Qwen/Qwen2-1.5B-Instruct11.3
Qwen2-0.5B-InstructmediumGSM8Kqwen2-0-5bQwen418Qwen/Qwen2-0.5B11.3
OLMo-2-0425-1B-InstructlowUnknownolmo-2-0425-1b-rlvr1allenai419allenai/OLMo-2-0425-1B-RLVR110.8
OLMo-2-0425-1B-SFTlowUnknownolmo-2-0425-1ballenai420allenai/OLMo-2-0425-1B10.8
OLMo-2-0425-1B-DPOlowUnknownUnknownallenai421allenai/OLMo-2-0425-1B-SFT10.8
OLMo-2-0425-1B-Instruct-GGUFlowUnknownolmo-2-0425-1b-instructunsloth422allenai/OLMo-2-0425-1B-Instruct10.8
OLMo-2-0425-1B-InstructlowUnknownolmo-2-0425-1b-instructunsloth423allenai/OLMo-2-0425-1B-Instruct10.8
OLMo-2-0425-1B-RLVR1lowUnknownUnknownallenai424allenai/OLMo-2-0425-1B-DPO10.8
Gemmalpaca-2BmediumGSM8k (5-shot)gemma-2bmlabonne425google/gemma-2b10.69
OLMo-1B-0724-hfmediumGSM8kolmo-1b-0724-hfallenai426allenai/OLMo-1B-0724-hf10
OLMo-7B-0424-hfmediumGSM8kolmo-7b-0424-hfallenai427allenai/OLMo-7B-0424-hf10
OLMo-7B-0724-hfmediumGSM8kolmo-7b-0724-hfallenai428allenai/OLMo-7B-0724-hf10
OLMo-7B-0424mediumGSM8kUnknownallenai429allenai/OLMo-7B-042410
MLewd-v2.4-13B-GGUFmediumGSM8K (5-shot)UnknownTheBloke430Undi95/MLewd-v2.4-13B9.78
llama2-7B-layla-GGUFmediumGSM8K (5-shot)UnknownTheBloke431l3utterfly/llama2-7b-layla8.49
MetaMath-Mistral-7B-GGUFlowUnknownUnknownTheBloke432meta-math/MetaMath-Mistral-7B6.8
Arithmo-Mistral-7B-GGUFlowUnknownUnknownTheBloke433akjindal53244/Arithmo-Mistral-7B6.8
SmolLM2-360M-Instruct-GGUFmediumGSM8K (5-shot)smollm2-360mMungert434HuggingFaceTB/SmolLM2-360M3.2
open-llama-3b-v2-wizard-evol-instuct-v2-196k-GGUFmediumGSM8K (5-shot)open-llama-3b-v2-wizard-evol-instuct-v2-196kTheBloke435harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196k1.9
t5gemma-2-270m-270mmedium[GSM8K]t5gemma-2-270m-270mgoogle436google/t5gemma-2-270m-270m1.7
t5gemma-2-4b-4bmedium[GSM8K]t5gemma-2-4b-4bgoogle437google/t5gemma-2-4b-4b1.7
t5gemma-2-1b-1bmedium[GSM8K]t5gemma-2-1b-1bgoogle438google/t5gemma-2-1b-1b1.7
SmolLM2-135M-Instruct-GGUFmediumGSM8K (5-shot)smollm2-135mMungert439HuggingFaceTB/SmolLM2-135M1.4
Provenance & metadata (1)

source

kind
leaderboard-scrape
paths
benchmarks/gsm8k.html