Leaderboard

MATH-500

math-500

Record

Category: math
Scored models: 141

Scores

Model	Score
nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	97.75
nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	97.75
facebook/cwm	97.2
facebook/cwm-pretrain	97.2
nvidia/Nemotron-H-47B-Reasoning-128K	96.6
nvidia/Nemotron-H-47B-Reasoning-128K	96.6
nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	96.3
nvidia/NVIDIA-Nemotron-Nano-9B-v2	96.3
nvidia/NVIDIA-Nemotron-Nano-9B-v2	96.3
nvidia/NVIDIA-Nemotron-Nano-9B-v2	96.3
nvidia/NVIDIA-Nemotron-Nano-9B-v2	95.4
nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	95.4
nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	95.4
nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	95.4
nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	95.4
Qwen/Qwen3-8B	95.1
nvidia/Nemotron-H-8B-Reasoning-128K	94.8
nvidia/Nemotron-H-8B-Reasoning-128K	94.8
inclusionAI/Rubicon-Preview	94.75
deepseek-ai/DeepSeek-R1-Distill-Llama-70B	94.5
deepseek-ai/DeepSeek-R1-Distill-Llama-70B	94.5
perplexity-ai/r1-1776-distill-llama-70b	94.5
deepseek-ai/DeepSeek-R1-Distill-Llama-70B	94.5
deepseek-ai/DeepSeek-R1-Distill-Llama-70B	94.5

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: math
id: math-500
name: MATH-500
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
NVIDIA-Nemotron-Nano-12B-v2	medium	MATH500	nvidia-nemotron-nano-12b-v2-base	nvidia	1	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	97.75
NVIDIA-Nemotron-Nano-12B-v2-GGUF	medium	MATH500	nvidia-nemotron-nano-12b-v2-base	Mungert	2	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	97.75
cwm	low	Unknown	Unknown	facebook	3	facebook/cwm	97.2
cwm-pretrain	low	Unknown	Unknown	facebook	4	facebook/cwm-pretrain	97.2
Nemotron-H-47B-Reasoning-128K	medium	MATH500	nemotron-h-47b-reasoning-128k	nvidia	5	nvidia/Nemotron-H-47B-Reasoning-128K	96.6
Nemotron-H-47B-Reasoning-128K-FP8	medium	MATH500	nemotron-h-47b-reasoning-128k	nvidia	6	nvidia/Nemotron-H-47B-Reasoning-128K	96.6
NVIDIA-Nemotron-Nano-9B-v2	medium	MATH500	nvidia-nemotron-nano-12b-v2-base	nvidia	7	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	96.3
NVIDIA-Nemotron-Nano-9B-v2-FP8	medium	MATH500	nvidia-nemotron-nano-12b-v2-base	nvidia	8	nvidia/NVIDIA-Nemotron-Nano-9B-v2	96.3
NVIDIA-Nemotron-Nano-9B-v2-NVFP4	medium	MATH500	nvidia-nemotron-nano-12b-v2-base	nvidia	9	nvidia/NVIDIA-Nemotron-Nano-9B-v2	96.3
NVIDIA-Nemotron-Nano-9B-v2	medium	MATH500	nvidia-nemotron-nano-12b-v2-base	unsloth	10	nvidia/NVIDIA-Nemotron-Nano-9B-v2	96.3
NVIDIA-Nemotron-3-Nano-4B-BF16	medium	MATH500	nvidia-nemotron-nano-12b-v2-base	nvidia	11	nvidia/NVIDIA-Nemotron-Nano-9B-v2	95.4
NVIDIA-Nemotron-3-Nano-4B-FP8	medium	MATH500	nvidia-nemotron-nano-9b-v2	nvidia	12	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	95.4
NVIDIA-Nemotron-3-Nano-4B	medium	MATH500	nvidia-nemotron-nano-9b-v2	unsloth	13	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	95.4
NVIDIA-Nemotron-3-Nano-4B-GGUF	medium	MATH500	nvidia-nemotron-nano-9b-v2	unsloth	14	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	95.4
NVIDIA-Nemotron-3-Nano-4B-FP8	medium	MATH500	nvidia-nemotron-nano-9b-v2	unsloth	15	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	95.4
Qwen3-8B-DMS-8x	medium	MATH-500	qwen3-8b-base	nvidia	16	Qwen/Qwen3-8B	95.1
Nemotron-H-8B-Reasoning-128K	medium	MATH500	nemotron-h-8b-reasoning-128k	nvidia	17	nvidia/Nemotron-H-8B-Reasoning-128K	94.8
Nemotron-H-8B-Reasoning-128K-FP8	medium	MATH500	nemotron-h-8b-reasoning-128k	nvidia	18	nvidia/Nemotron-H-8B-Reasoning-128K	94.8
Rubicon-Preview	low	Unknown	rubicon-preview	inclusionAI	19	inclusionAI/Rubicon-Preview	94.75
DeepSeek-R1-Distill-Llama-70B	high	Unknown	deepseek-r1-distill-llama-70b	deepseek-ai	20	deepseek-ai/DeepSeek-R1-Distill-Llama-70B	94.5
DeepSeek-R1-Distill-Llama-70B-GGUF	high	Unknown	deepseek-r1-distill-llama-70b	unsloth	21	deepseek-ai/DeepSeek-R1-Distill-Llama-70B	94.5
r1-1776-distill-llama-70b-GGUF	medium	MATH-500	Unknown	unsloth	22	perplexity-ai/r1-1776-distill-llama-70b	94.5
DeepSeek-R1-Distill-Llama-70B-bnb-4bit	high	Unknown	deepseek-r1-distill-llama-70b	unsloth	23	deepseek-ai/DeepSeek-R1-Distill-Llama-70B	94.5
DeepSeek-R1-Distill-Llama-70B-GGUF	high	Unknown	deepseek-r1-distill-llama-70b	Mungert	24	deepseek-ai/DeepSeek-R1-Distill-Llama-70B	94.5
DeepSeek-R1-Distill-Llama-70B-unsloth-bnb-4bit	high	Unknown	deepseek-r1-distill-llama-70b	unsloth	25	deepseek-ai/DeepSeek-R1-Distill-Llama-70B	94.5
DeepSeek-R1-Distill-Llama-70B	high	Unknown	deepseek-r1-distill-llama-70b	unsloth	26	deepseek-ai/DeepSeek-R1-Distill-Llama-70B	94.5
DeepSeek-R1-Distill-Qwen-32B	high	Unknown	deepseek-r1-distill-qwen-32b	deepseek-ai	27	deepseek-ai/DeepSeek-R1-Distill-Qwen-32B	94.3
DeepSeek-R1-Distill-Qwen-32B-GGUF	high	Unknown	deepseek-r1-distill-qwen-32b	unsloth	28	deepseek-ai/DeepSeek-R1-Distill-Qwen-32B	94.3
DeepSeek-R1-Distill-Qwen-32B-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-32b	unsloth	29	deepseek-ai/DeepSeek-R1-Distill-Qwen-32B	94.3
DeepSeek-R1-Distill-Qwen-32B	high	Unknown	deepseek-r1-distill-qwen-32b	unsloth	30	deepseek-ai/DeepSeek-R1-Distill-Qwen-32B	94.3
DeepSeek-R1-Distill-Qwen-32B-unsloth-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-32b	unsloth	31	deepseek-ai/DeepSeek-R1-Distill-Qwen-32B	94.3
DeepSeek-R1-Distill-Qwen-32B-GGUF	high	Unknown	deepseek-r1-distill-qwen-32b	Mungert	32	deepseek-ai/DeepSeek-R1-Distill-Qwen-32B	94.3
DeepSeek-V3-0324-NVFP4	medium	MATH-500	deepseek-v3-0324	nvidia	33	deepseek-ai/DeepSeek-V3-0324	94
DeepSeek-R1-Distill-Qwen-14B	high	Unknown	deepseek-r1-distill-qwen-14b	deepseek-ai	34	deepseek-ai/DeepSeek-R1-Distill-Qwen-14B	93.9
DeepSeek-R1-Distill-Qwen-14B-GGUF	high	Unknown	deepseek-r1-distill-qwen-14b	unsloth	35	deepseek-ai/DeepSeek-R1-Distill-Qwen-14B	93.9
DeepSeek-R1-Distill-Qwen-14B-unsloth-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-14b	unsloth	36	deepseek-ai/DeepSeek-R1-Distill-Qwen-14B	93.9
DeepSeek-R1-Distill-Qwen-14B-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-14b	unsloth	37	deepseek-ai/DeepSeek-R1-Distill-Qwen-14B	93.9
DeepSeek-R1-Distill-Qwen-14B	high	Unknown	deepseek-r1-distill-qwen-14b	unsloth	38	deepseek-ai/DeepSeek-R1-Distill-Qwen-14B	93.9
DeepSeek-R1-Distill-Qwen-14B-GGUF	high	Unknown	deepseek-r1-distill-qwen-14b	Mungert	39	deepseek-ai/DeepSeek-R1-Distill-Qwen-14B	93.9
Ring-lite-linear-preview	high	Unknown	ling-lite	inclusionAI	40	inclusionAI/Ling-lite	93.8
Ring-lite-distill-preview	high	Unknown	ling-lite	inclusionAI	41	inclusionAI/Ling-lite	93.7
DeepSeek-R1-Distill-Qwen-7B	high	Unknown	deepseek-r1-distill-qwen-7b	deepseek-ai	42	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	92.8
DeepSeek-R1-Distill-Qwen-7B-GGUF	high	Unknown	deepseek-r1-distill-qwen-7b	unsloth	43	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	92.8
DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-7b	unsloth	44	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	92.8
DeepSeek-R1-Distill-Qwen-7B-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-7b	unsloth	45	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	92.8
DeepSeek-R1-Distill-Qwen-7B	high	Unknown	deepseek-r1-distill-qwen-7b	unsloth	46	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	92.8
DeepSeek-R1-Distill-Qwen-7B-GGUF	high	Unknown	deepseek-r1-distill-qwen-7b	Mungert	47	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	92.8
AceMath-RL-Nemotron-7B	low	Unknown	acemath-rl-nemotron-7b	nvidia	48	nvidia/AceMath-RL-Nemotron-7B	92.8
DistilQwen2.5-R1-3B	low	Unknown	Unknown	alibaba-pai	49	alibaba-pai/DistilQwen2.5-R1-3B	92.8
AceMath-RL-Nemotron-7B-GGUF	low	Unknown	acemath-rl-nemotron-7b	Mungert	50	nvidia/AceMath-RL-Nemotron-7B	92.8
Phi-4-mini-reasoning	low	Unknown	phi-4-mini-reasoning	microsoft	51	microsoft/Phi-4-mini-reasoning	90
Phi-4-mini-reasoning-GGUF	low	Unknown	phi-4-mini-reasoning	unsloth	52	microsoft/Phi-4-mini-reasoning	90
Phi-4-mini-reasoning-unsloth-bnb-4bit	low	Unknown	phi-4-mini-reasoning	unsloth	53	microsoft/Phi-4-mini-reasoning	90
Phi-4-mini-reasoning	low	Unknown	phi-4-mini-reasoning	unsloth	54	microsoft/Phi-4-mini-reasoning	90
Phi-4-mini-reasoning-GGUF	low	Unknown	phi-4-mini-reasoning	Mungert	55	microsoft/Phi-4-mini-reasoning	90
Phi-4-mini-reasoning-bnb-4bit	low	Unknown	phi-4-mini-reasoning	unsloth	56	microsoft/Phi-4-mini-reasoning	90
DeepSeek-R1-Distill-Llama-8B	high	Unknown	deepseek-r1-distill-llama-8b	deepseek-ai	57	deepseek-ai/DeepSeek-R1-Distill-Llama-8B	89.1
DeepSeek-R1-Distill-Llama-8B-GGUF	high	Unknown	deepseek-r1-distill-llama-8b	unsloth	58	deepseek-ai/DeepSeek-R1-Distill-Llama-8B	89.1
DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit	high	Unknown	deepseek-r1-distill-llama-8b	unsloth	59	deepseek-ai/DeepSeek-R1-Distill-Llama-8B	89.1
DeepSeek-R1-Distill-Llama-8B	high	Unknown	deepseek-r1-distill-llama-8b	unsloth	60	deepseek-ai/DeepSeek-R1-Distill-Llama-8B	89.1
DeepSeek-R1-Distill-Llama-8B-bnb-4bit	high	Unknown	deepseek-r1-distill-llama-8b	unsloth	61	deepseek-ai/DeepSeek-R1-Distill-Llama-8B	89.1
DeepSeek-R1-Distill-Llama-8B-GGUF	high	Unknown	deepseek-r1-distill-llama-8b	Mungert	62	deepseek-ai/DeepSeek-R1-Distill-Llama-8B	89.1
LFM2.5-8B-A1B-GGUF	high	Unknown	lfm2-5-8b-a1b	unsloth	63	LiquidAI/LFM2.5-8B-A1B	88.76
LFM2.5-8B-A1B	high	Unknown	lfm2-5-8b-a1b	unsloth	64	LiquidAI/LFM2.5-8B-A1B	88.76
LFM2.5-8B-A1B-GGUF	high	Unknown	lfm2-5-8b-a1b-base	Mungert	65	LiquidAI/LFM2.5-8B-A1B-Base	88.76
Sky-T1-32B-Flash	medium	Math500	qwen2-5-32b-instruct	NovaSky-AI	66	Qwen/Qwen2.5-32B-Instruct	88.6
NFT-32B	medium	MATH500	qwen2-5-32b	nvidia	67	Qwen/Qwen2.5-32B	88.4
ZR1-1.5B-GGUF	high	Unknown	deepseek-r1-distill-qwen-1-5b	Mungert	68	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	88.34
Youtu-LLM-2B-GGUF	medium	MATH-500	youtu-llm-2b-base	Mungert	69	tencent/Youtu-LLM-2B-Base	84.8
Phi-4-mini-flash-reasoning	low	Unknown	Unknown	microsoft	70	microsoft/Phi-4-mini-flash-reasoning	84.5
Nemotron-Labs-TwoTower-30B-A3B-Base-BF16	medium	MATH-500 (4-shot)	nemotron-labs-twotower-30b-a3b-base-bf16	nvidia	71	nvidia/Nemotron-Labs-TwoTower-30B-A3B-Base-BF16	84.4
DeepSeek-R1-Distill-Qwen-1.5B	high	Unknown	deepseek-r1-distill-qwen-1-5b	deepseek-ai	72	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	83.9
DeepSeek-R1-Distill-Qwen-1.5B-GGUF	high	Unknown	deepseek-r1-distill-qwen-1-5b	unsloth	73	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	83.9
DeepSeek-R1-Distill-Qwen-1.5B-unsloth-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-1-5b	unsloth	74	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	83.9
DeepSeek-R1-Distill-Qwen-1.5B-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-1-5b	unsloth	75	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	83.9
DeepSeek-R1-Distill-Qwen-1.5B	high	Unknown	deepseek-r1-distill-qwen-1-5b	unsloth	76	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	83.9
DeepSeek-R1-Distill-Qwen-1.5B-GGUF	high	Unknown	deepseek-r1-distill-qwen-1-5b	Mungert	77	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	83.9
Falcon-H1-34B-Instruct	medium	MATH-500	falcon-h1-34b-base	tiiuae	78	tiiuae/Falcon-H1-34B-Base	83.8
Falcon-H1-34B-Instruct-GGUF	medium	MATH-500	falcon-h1-34b-instruct	tiiuae	79	tiiuae/Falcon-H1-34B-Instruct	83.8
Falcon-H1-34B-Instruct-GGUF	medium	MATH-500	falcon-h1-34b-instruct	unsloth	80	tiiuae/Falcon-H1-34B-Instruct	83.8
Falcon-H1-34B-Instruct-GPTQ-Int4	medium	MATH-500	falcon-h1-34b-instruct	tiiuae	81	tiiuae/Falcon-H1-34B-Instruct	83.8
NFT-7B	medium	MATH500	qwen2-5-math-7b	nvidia	82	Qwen/Qwen2.5-Math-7B	83.2
AceMath-7B-RM	low	Unknown	acemath-7b-rm	nvidia	83	nvidia/AceMath-7B-RM	83.11
AceMath-72B-RM	low	Unknown	acemath-72b-rm	nvidia	84	nvidia/AceMath-72B-RM	83.11
OpenThinker3-7B-GGUF	low	Unknown	qwen2-5-7b-instruct	Mungert	85	Qwen/Qwen2.5-7B-Instruct	82.8
SmallThinker-21BA3B-Instruct-GGUF	low	Unknown	Unknown	Mungert	86	—	82.4
Sky-T1-32B-Preview	medium	Math500	qwen2-5-32b-instruct	NovaSky-AI	87	Qwen/Qwen2.5-32B-Instruct	82.4
AReaL-1.5B-Preview-Stage-2	low	Unknown	Unknown	inclusionAI	88	inclusionAI/AReaL-1.5B-Preview-Stage-2	81.4
AReaL-1.5B-Preview-Stage-3	low	Unknown	Unknown	inclusionAI	89	inclusionAI/AReaL-1.5B-Preview-Stage-3	81.4
AReaL-1.5B-Preview-Stage-1	low	Unknown	Unknown	inclusionAI	90	inclusionAI/AReaL-1.5B-Preview-Stage-1	81.4
Llama-3_1-Nemotron-Ultra-253B-CPT-v1	medium	MATH500	Unknown	nvidia	91	nvidia/Llama-3_1-Nemotron-Ultra-253B-CPT-v1	80.4
DeepScaleR-1.5B-Preview-unsloth-bnb-4bit	low	Unknown	deepscaler-1-5b-preview	unsloth	92	agentica-org/DeepScaleR-1.5B-Preview	79.8
Falcon-H1-1.5B-Deep-Instruct	medium	MATH-500	falcon-h1-1-5b-deep-base	tiiuae	93	tiiuae/Falcon-H1-1.5B-Deep-Base	77.8
Falcon-H1-1.5B-Deep-Instruct-GGUF	medium	MATH-500	falcon-h1-1-5b-deep-instruct	tiiuae	94	tiiuae/Falcon-H1-1.5B-Deep-Instruct	77.8
Falcon-H1-1.5B-Deep-Instruct-GGUF	medium	MATH-500	falcon-h1-1-5b-deep-instruct	unsloth	95	tiiuae/Falcon-H1-1.5B-Deep-Instruct	77.8
Falcon-H1-1.5B-Deep-Instruct	medium	MATH-500	falcon-h1-1-5b-deep-instruct	unsloth	96	tiiuae/Falcon-H1-1.5B-Deep-Instruct	77.8
Falcon-H1-1.5B-Deep-Instruct-GPTQ-Int4	medium	MATH-500	falcon-h1-1-5b-deep-instruct	tiiuae	97	tiiuae/Falcon-H1-1.5B-Deep-Instruct	77.8
Nemotron-H-4B-Instruct-128K	low	Unknown	nemotron-h-4b-base-8k	nvidia	98	nvidia/Nemotron-H-4B-Base-8K	76.4
LFM2.5-8B-A1B-GGUF	medium	MATH500	lfm2-5-8b-a1b	unsloth	99	LiquidAI/LFM2.5-8B-A1B	74.8
LFM2.5-8B-A1B	medium	MATH500	lfm2-5-8b-a1b	unsloth	100	LiquidAI/LFM2.5-8B-A1B	74.8
LFM2.5-8B-A1B-GGUF	medium	MATH500	lfm2-5-8b-a1b-base	Mungert	101	LiquidAI/LFM2.5-8B-A1B-Base	74.8
DeepSeek-R1	low	Unknown	deepseek-r1	deepseek-ai	102	deepseek-ai/DeepSeek-R1	74.6
DeepSeek-R1-GGUF	low	Unknown	deepseek-r1	unsloth	103	deepseek-ai/DeepSeek-R1	74.6
DeepSeek-R1-Zero	low	Unknown	deepseek-r1-zero	deepseek-ai	104	deepseek-ai/DeepSeek-R1-Zero	74.6
DeepSeek-R1-BF16	low	Unknown	deepseek-r1	unsloth	105	deepseek-ai/DeepSeek-R1	74.6
DeepSeek-R1-GGUF-UD	low	Unknown	deepseek-r1	unsloth	106	deepseek-ai/DeepSeek-R1	74.6
DeepSeek-R1-Zero-GGUF	low	Unknown	deepseek-r1-zero	unsloth	107	deepseek-ai/DeepSeek-R1-Zero	74.6
DeepSeek-R1	low	Unknown	deepseek-r1	unsloth	108	deepseek-ai/DeepSeek-R1	74.6
Falcon-H1-3B-Instruct	medium	MATH-500	falcon-h1-3b-base	tiiuae	109	tiiuae/Falcon-H1-3B-Base	74.2
LFM2-8B-A1B-GGUF	low	Unknown	lfm2-8b-a1b	unsloth	110	LiquidAI/LFM2-8B-A1B	74.2
Falcon-H1-3B-Instruct-GGUF	medium	MATH-500	falcon-h1-3b-base	tiiuae	111	tiiuae/Falcon-H1-3B-Base	74.2
Falcon-H1-3B-Instruct-GGUF	medium	MATH-500	falcon-h1-3b-instruct	unsloth	112	tiiuae/Falcon-H1-3B-Instruct	74.2
LFM2-8B-A1B	low	Unknown	lfm2-8b-a1b	unsloth	113	LiquidAI/LFM2-8B-A1B	74.2
Falcon-H1-1.5B-Instruct	medium	MATH-500	falcon-h1-1-5b-base	tiiuae	114	tiiuae/Falcon-H1-1.5B-Base	74
Falcon-H1-1.5B-Instruct-GGUF	medium	MATH-500	falcon-h1-1-5b-instruct	tiiuae	115	tiiuae/Falcon-H1-1.5B-Instruct	74
Falcon-H1-1.5B-Instruct-GGUF	medium	MATH-500	falcon-h1-1-5b-instruct	unsloth	116	tiiuae/Falcon-H1-1.5B-Instruct	74
Falcon-H1-1.5B-Instruct-GPTQ-Int4	medium	MATH-500	falcon-h1-1-5b-instruct	tiiuae	117	tiiuae/Falcon-H1-1.5B-Instruct	74
Falcon-H1-1.5B-Instruct-GPTQ-Int8	medium	MATH-500	falcon-h1-1-5b-instruct	tiiuae	118	tiiuae/Falcon-H1-1.5B-Instruct	74
Falcon-H1-7B-Instruct	medium	MATH-500	falcon-h1-7b-base	tiiuae	119	tiiuae/Falcon-H1-7B-Base	73.4
Falcon-H1-7B-Instruct-GPTQ-Int4	medium	MATH-500	falcon-h1-7b-instruct	tiiuae	120	tiiuae/Falcon-H1-7B-Instruct	73.4
Falcon-H1-7B-Instruct-GGUF	medium	MATH-500	falcon-h1-7b-instruct	tiiuae	121	tiiuae/Falcon-H1-7B-Instruct	73.4
Falcon-H1-7B-Instruct-GGUF	medium	MATH-500	falcon-h1-7b-instruct	unsloth	122	tiiuae/Falcon-H1-7B-Instruct	73.4
OREAL-7B	low	Unknown	oreal-7b-sft	internlm	123	internlm/OREAL-7B-SFT	72.8
OREAL-32B	low	Unknown	oreal-32b-sft	internlm	124	internlm/OREAL-32B-SFT	72.8
OREAL-7B-SFT	low	Unknown	qwen2-5-7b	internlm	125	Qwen/Qwen2.5-7B	72.8
OREAL-DeepSeek-R1-Distill-Qwen-7B	low	Unknown	deepseek-r1-distill-qwen-7b	internlm	126	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	72.8
GigaChat3-10B-A1.8B-GGUF	medium	MATH_500_FOUR_SHOT	Unknown	Mungert	127	ai-sage/GigaChat3-10B-A1.8B-bf16	70
SynLogic-7B	low	Unknown	qwen2-5-7b	MiniMaxAI	128	Qwen/Qwen2.5-7B	64.6
LFM2.5-1.2B-Thinking-GGUF	low	Unknown	lfm2-5-1-2b-thinking	unsloth	129	LiquidAI/LFM2.5-1.2B-Thinking	63.2
LFM2.5-1.2B-Thinking-GGUF	low	Unknown	lfm2-5-1-2b-base	Mungert	130	LiquidAI/LFM2.5-1.2B-Base	63.2
Falcon-H1-0.5B-Instruct	medium	MATH-500	falcon-h1-0-5b-base	tiiuae	131	tiiuae/Falcon-H1-0.5B-Base	58.4
Falcon-H1-0.5B-Instruct-GGUF	medium	MATH-500	falcon-h1-0-5b-base	tiiuae	132	tiiuae/Falcon-H1-0.5B-Base	58.4
Falcon-H1-0.5B-Instruct-GGUF	medium	MATH-500	falcon-h1-0-5b-instruct	unsloth	133	tiiuae/Falcon-H1-0.5B-Instruct	58.4
Nemotron-H-47B-Base-8K	low	GSM8K 8-shot CoT \| MATH 4-shot CoT \| MATH-Lvl 5 4-shot CoT \| MATH-500 4-shot CoT	nemotron-h-56b-base-8k	nvidia	134	nvidia/Nemotron-H-56B-Base-8K	57.9
Nemotron-H-56B-Base-8K	low	GSM8K 8-shot CoT \| MATH 4-shot CoT \| MATH-Lvl 5 4-shot CoT \| MATH-500 4-shot CoT	nemotron-h-56b-base-8k	nvidia	135	nvidia/Nemotron-H-56B-Base-8K	57.37
NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16	medium	MATH-500 (4-shot, avg@32)	nvidia-nemotron-3-nano-30b-a3b-base-bf16	nvidia	136	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16	55.08
Nemotron-H-8B-Base-8K	low	GSM8K 8-shot CoT \| MATH 4-shot CoT \| MATH-Lvl 5 4-shot CoT \| MATH-500 4-shot CoT	nemotron-h-8b-base-8k	nvidia	137	nvidia/Nemotron-H-8B-Base-8K	44.43
Llama-3.2-3B-F1-Reasoning-Instruct-GGUF	low	Unknown	llama-3-2-3b	Mungert	138	meta-llama/Llama-3.2-3B	44.4
bitnet-b1.58-2B-4T-gguf	medium	MATH-500	bitnet-b1-58-2b-4t-bf16	microsoft	139	microsoft/bitnet-b1.58-2B-4T-bf16	23
bitnet-b1.58-2B-4T	medium	MATH-500	bitnet-b1-58-2b-4t	microsoft	140	microsoft/bitnet-b1.58-2B-4T	23
bitnet-b1.58-2B-4T-bf16	medium	MATH-500	bitnet-b1-58-2b-4t-bf16	microsoft	141	microsoft/bitnet-b1.58-2B-4T-bf16	23

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/math-500.html
url: huggingface.co/spaces/math ↗