Leaderboard

AIME 2024

aime-2024

Record

Category: math
Scored models: 199

Scores

Model	Score
mistralai/Mistral-Small-3.2-24B-Instruct-2506	91.82
mistralai/Magistral-Small-2509	91.82
mistralai/Magistral-Small-2509	91.82
mistralai/Mistral-Small-3.2-24B-Instruct-2506	91.82
mistralai/Magistral-Small-2509	91.82
mistralai/Magistral-Small-2509	91.82
facebook/cwm	86.1
facebook/cwm-pretrain	86.1
mistralai/Ministral-3-3B-Base-2512	83.7
mistralai/Ministral-3-3B-Base-2512	83.7
mistralai/Ministral-3-14B-Base-2512	83.7
mistralai/Ministral-3-3B-Base-2512	83.7
mistralai/Ministral-3-8B-Base-2512	83.7
mistralai/Ministral-3-14B-Base-2512	83.7
mistralai/Ministral-3-8B-Base-2512	83.7
mistralai/Ministral-3-3B-Reasoning-2512	83.7
mistralai/Ministral-3-8B-Base-2512	83.7
mistralai/Ministral-3-14B-Base-2512	83.7
mistralai/Ministral-3-3B-Instruct-2512	83.7
mistralai/Ministral-3-8B-Instruct-2512	83.7
mistralai/Ministral-3-8B-Base-2512	83.7
mistralai/Ministral-3-14B-Instruct-2512	83.7
mistralai/Ministral-3-3B-Base-2512	83.7
mistralai/Ministral-3-14B-Reasoning-2512	83.7

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: math
id: aime-2024
name: AIME 2024
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
Magistral-Small-2509	low	Unknown	mistral-small-3-1-24b-base-2503	mistralai	1	mistralai/Mistral-Small-3.2-24B-Instruct-2506	91.82
Magistral-Small-2509-GGUF	low	Unknown	magistral-small-2509	unsloth	2	mistralai/Magistral-Small-2509	91.82
Magistral-Small-2509-FP8-Dynamic	low	Unknown	magistral-small-2509	unsloth	3	mistralai/Magistral-Small-2509	91.82
Magistral-Small-2509-GGUF	low	Unknown	mistral-small-3-1-24b-base-2503	Mungert	4	mistralai/Mistral-Small-3.2-24B-Instruct-2506	91.82
Magistral-Small-2509-unsloth-bnb-4bit	low	Unknown	magistral-small-2509	unsloth	5	mistralai/Magistral-Small-2509	91.82
Magistral-Small-2509-bnb-4bit	low	Unknown	magistral-small-2509	unsloth	6	mistralai/Magistral-Small-2509	91.82
cwm	low	Unknown	Unknown	facebook	7	facebook/cwm	86.1
cwm-pretrain	low	Unknown	Unknown	facebook	8	facebook/cwm-pretrain	86.1
Ministral-3-3B-Instruct-2512	low	Unknown	ministral-3-3b-base-2512	mistralai	9	mistralai/Ministral-3-3B-Base-2512	83.7
Ministral-3-3B-Instruct-2512-BF16	low	Unknown	ministral-3-3b-base-2512	mistralai	10	mistralai/Ministral-3-3B-Base-2512	83.7
Ministral-3-14B-Instruct-2512	low	Unknown	ministral-3-14b-base-2512	mistralai	11	mistralai/Ministral-3-14B-Base-2512	83.7
Ministral-3-3B-Reasoning-2512	low	Unknown	ministral-3-3b-base-2512	mistralai	12	mistralai/Ministral-3-3B-Base-2512	83.7
Ministral-3-8B-Instruct-2512	low	Unknown	ministral-3-8b-base-2512	mistralai	13	mistralai/Ministral-3-8B-Base-2512	83.7
Ministral-3-14B-Reasoning-2512	low	Unknown	ministral-3-14b-base-2512	mistralai	14	mistralai/Ministral-3-14B-Base-2512	83.7
Ministral-3-8B-Reasoning-2512	low	Unknown	ministral-3-8b-base-2512	mistralai	15	mistralai/Ministral-3-8B-Base-2512	83.7
Ministral-3-3B-Reasoning-2512-GGUF	low	Unknown	ministral-3-3b-reasoning-2512	unsloth	16	mistralai/Ministral-3-3B-Reasoning-2512	83.7
Ministral-3-8B-Instruct-2512-BF16	low	Unknown	ministral-3-8b-base-2512	mistralai	17	mistralai/Ministral-3-8B-Base-2512	83.7
Ministral-3-14B-Instruct-2512-BF16	low	Unknown	ministral-3-14b-base-2512	mistralai	18	mistralai/Ministral-3-14B-Base-2512	83.7
Ministral-3-3B-Instruct-2512-GGUF	low	Unknown	ministral-3-3b-base-2512	unsloth	19	mistralai/Ministral-3-3B-Instruct-2512	83.7
Ministral-3-8B-Instruct-2512-GGUF	low	Unknown	ministral-3-8b-instruct-2512	unsloth	20	mistralai/Ministral-3-8B-Instruct-2512	83.7
Ministral-3-8B-Base-2512	low	Unknown	ministral-3-8b-base-2512	mistralai	21	mistralai/Ministral-3-8B-Base-2512	83.7
Ministral-3-14B-Instruct-2512-GGUF	low	Unknown	ministral-3-14b-instruct-2512	unsloth	22	mistralai/Ministral-3-14B-Instruct-2512	83.7
Ministral-3-3B-Base-2512	low	Unknown	ministral-3-3b-base-2512	mistralai	23	mistralai/Ministral-3-3B-Base-2512	83.7
Ministral-3-14B-Reasoning-2512-GGUF	low	Unknown	ministral-3-14b-reasoning-2512	unsloth	24	mistralai/Ministral-3-14B-Reasoning-2512	83.7
Ministral-3-14B-Base-2512	low	Unknown	ministral-3-14b-base-2512	mistralai	25	mistralai/Ministral-3-14B-Base-2512	83.7
Ministral-3-8B-Reasoning-2512-GGUF	low	Unknown	ministral-3-8b-reasoning-2512	unsloth	26	mistralai/Ministral-3-8B-Reasoning-2512	83.7
Ministral-3-3B-Instruct-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-3b-base-2512	unsloth	27	mistralai/Ministral-3-3B-Instruct-2512	83.7
Ministral-3-3B-Reasoning-2512	low	Unknown	ministral-3-3b-reasoning-2512	unsloth	28	mistralai/Ministral-3-3B-Reasoning-2512	83.7
Ministral-3-8B-Instruct-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-8b-instruct-2512	unsloth	29	mistralai/Ministral-3-8B-Instruct-2512	83.7
Ministral-3-8B-Instruct-2512	low	Unknown	ministral-3-8b-instruct-2512	unsloth	30	mistralai/Ministral-3-8B-Instruct-2512	83.7
Ministral-3-3B-Instruct-2512	low	Unknown	ministral-3-3b-base-2512	unsloth	31	mistralai/Ministral-3-3B-Instruct-2512	83.7
Ministral-3-14B-Instruct-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-14b-instruct-2512	unsloth	32	mistralai/Ministral-3-14B-Instruct-2512	83.7
Ministral-3-14B-Instruct-2512-bnb-4bit	low	Unknown	ministral-3-14b-instruct-2512	unsloth	33	mistralai/Ministral-3-14B-Instruct-2512	83.7
Ministral-3-14B-Instruct-2512	low	Unknown	ministral-3-14b-instruct-2512	unsloth	34	mistralai/Ministral-3-14B-Instruct-2512	83.7
Ministral-3-3B-Base-2512	low	Unknown	ministral-3-3b-base-2512	unsloth	35	mistralai/Ministral-3-3B-Base-2512	83.7
Ministral-3-3B-Base-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-3b-base-2512	unsloth	36	mistralai/Ministral-3-3B-Base-2512	83.7
Ministral-3-14B-Reasoning-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-14b-reasoning-2512	unsloth	37	mistralai/Ministral-3-14B-Reasoning-2512	83.7
Ministral-3-14B-Instruct-2512-FP8	low	Unknown	ministral-3-14b-instruct-2512	unsloth	38	mistralai/Ministral-3-14B-Instruct-2512	83.7
Ministral-3-3B-Reasoning-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-3b-reasoning-2512	unsloth	39	mistralai/Ministral-3-3B-Reasoning-2512	83.7
Ministral-3-3B-Instruct-2512-bnb-4bit	low	Unknown	ministral-3-3b-base-2512	unsloth	40	mistralai/Ministral-3-3B-Instruct-2512	83.7
Ministral-3-8B-Instruct-2512-FP8	low	Unknown	ministral-3-8b-instruct-2512	unsloth	41	mistralai/Ministral-3-8B-Instruct-2512	83.7
Ministral-3-14B-Reasoning-2512-bnb-4bit	low	Unknown	ministral-3-14b-reasoning-2512	unsloth	42	mistralai/Ministral-3-14B-Reasoning-2512	83.7
Ministral-3-3B-Base-2512-bnb-4bit	low	Unknown	ministral-3-3b-base-2512	unsloth	43	mistralai/Ministral-3-3B-Base-2512	83.7
Ministral-3-8B-Base-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-8b-base-2512	unsloth	44	mistralai/Ministral-3-8B-Base-2512	83.7
Ministral-3-8B-Reasoning-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-8b-reasoning-2512	unsloth	45	mistralai/Ministral-3-8B-Reasoning-2512	83.7
Ministral-3-8B-Instruct-2512-bnb-4bit	low	Unknown	ministral-3-8b-instruct-2512	unsloth	46	mistralai/Ministral-3-8B-Instruct-2512	83.7
Ministral-3-8B-Base-2512	low	Unknown	ministral-3-8b-base-2512	unsloth	47	mistralai/Ministral-3-8B-Base-2512	83.7
Ministral-3-8B-Reasoning-2512-GGUF	low	Unknown	ministral-3-8b-base-2512	Mungert	48	mistralai/Ministral-3-8B-Base-2512	83.7
Ministral-3-14B-Base-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-14b-base-2512	unsloth	49	mistralai/Ministral-3-14B-Base-2512	83.7
Ministral-3-14B-Reasoning-2512	low	Unknown	ministral-3-14b-reasoning-2512	unsloth	50	mistralai/Ministral-3-14B-Reasoning-2512	83.7
Ministral-3-3B-Instruct-2512-FP8	low	Unknown	ministral-3-3b-base-2512	unsloth	51	mistralai/Ministral-3-3B-Instruct-2512	83.7
Ministral-3-14B-Reasoning-2512-GGUF	low	Unknown	ministral-3-14b-base-2512	Mungert	52	mistralai/Ministral-3-14B-Base-2512	83.7
Ministral-3-3B-Reasoning-2512-GGUF	low	Unknown	ministral-3-3b-base-2512	Mungert	53	mistralai/Ministral-3-3B-Base-2512	83.7
Ministral-3-8B-Reasoning-2512	low	Unknown	ministral-3-8b-reasoning-2512	unsloth	54	mistralai/Ministral-3-8B-Reasoning-2512	83.7
Ministral-3-3B-Reasoning-2512-bnb-4bit	low	Unknown	ministral-3-3b-reasoning-2512	unsloth	55	mistralai/Ministral-3-3B-Reasoning-2512	83.7
OpenMath-Nemotron-1.5B	low	Unknown	qwen2-5-math-1-5b	nvidia	56	Qwen/Qwen2.5-Math-1.5B	83.3
OpenMath-Nemotron-7B	low	Unknown	qwen2-5-math-7b	nvidia	57	Qwen/Qwen2.5-Math-7B	83.3
OpenMath-Nemotron-32B	low	Unknown	qwen2-5-32b	nvidia	58	Qwen/Qwen2.5-32B	83.3
OpenMath-Nemotron-14B	low	Unknown	qwen2-5-14b	nvidia	59	Qwen/Qwen2.5-14B	83.3
OpenMath-Nemotron-1.5B-GGUF	low	Unknown	qwen2-5-math-1-5b	Mungert	60	Qwen/Qwen2.5-Math-1.5B	83.3
OpenMath-Nemotron-14B-Kaggle	low	Unknown	qwen2-5-14b	nvidia	61	Qwen/Qwen2.5-14B	83.3
OpenMath-Nemotron-32B-GGUF	low	Unknown	qwen2-5-32b	Mungert	62	Qwen/Qwen2.5-32B	83.3
OpenMath-Nemotron-14B-Kaggle-GGUF	low	Unknown	qwen2-5-14b	Mungert	63	Qwen/Qwen2.5-14B	83.3
OpenMath-Nemotron-7B-GGUF	low	Unknown	qwen2-5-math-7b	Mungert	64	Qwen/Qwen2.5-Math-7B	83.3
Qwen3-32B-AWQ	low	Unknown	qwen3-32b	Qwen	65	Qwen/Qwen3-32B	81.4
Olmo-3.1-32B-Think	medium	AIME 2024	olmo-3-32b-think-dpo	allenai	66	allenai/Olmo-3-32B-Think-DPO	80.6
Olmo-3.1-32B-Think-GGUF	medium	AIME 2024	olmo-3-1-32b-think	unsloth	67	allenai/Olmo-3.1-32B-Think	80.6
Qwen3-30B-A3B-GPTQ-Int4	low	Unknown	qwen3-30b-a3b-base	Qwen	68	Qwen/Qwen3-30B-A3B	80.4
Ring-mini-linear-2.0-GPTQ-int4	medium	AIME24	ring-mini-linear-2-0	inclusionAI	69	inclusionAI/Ring-mini-linear-2.0	79.95
Ring-flash-linear-2.0-GPTQ-int4	medium	AIME24	ring-mini-linear-2-0	inclusionAI	70	inclusionAI/Ring-mini-linear-2.0	79.95
FairyR1-32B-GGUF	medium	AIME 2024 (Math)	deepseek-r1-distill-qwen-32b	Mungert	71	deepseek-ai/DeepSeek-R1-Distill-Qwen-32B	79.8
AceReason-Nemotron-7B	low	Unknown	Unknown	nvidia	72	nvidia/AceReason-Nemotron-7B	79.5
AceReason-Nemotron-14B-GGUF	low	Unknown	Unknown	unsloth	73	nvidia/AceReason-Nemotron-14B	79.5
AceReason-Nemotron-14B	low	Unknown	Unknown	nvidia	74	nvidia/AceReason-Nemotron-14B	79.5
Qwen3-14B-AWQ	low	Unknown	qwen3-14b	Qwen	75	Qwen/Qwen3-14B	79.3
Nemotron-Cascade-14B-Thinking	medium	AIME 2024	nemotron-cascade-14b-thinking	nvidia	76	nvidia/Nemotron-Cascade-14B-Thinking	79.3
DASD-4B-Thinking-GGUF	low	Unknown	Unknown	Mungert	77	—	79.3
INTELLECT-2-GGUF	high	Unknown	intellect-2	unsloth	78	PrimeIntellect/INTELLECT-2	78.8
Rubicon-Preview	low	Unknown	rubicon-preview	inclusionAI	79	inclusionAI/Rubicon-Preview	77.5
Ring-lite	medium	AIME 2024	ling-lite-base-1-5	inclusionAI	80	inclusionAI/Ling-lite-base-1.5	76.6
Qwen3-8B-AWQ	low	Unknown	qwen3-8b-base	Qwen	81	Qwen/Qwen3-8B	76
Nemotron-Cascade-8B	medium	AIME 2024	nemotron-cascade-8b	nvidia	82	nvidia/Nemotron-Cascade-8B	76
Nemotron-Cascade-8B-Thinking	medium	AIME 2024	nemotron-cascade-8b-thinking	nvidia	83	nvidia/Nemotron-Cascade-8B-Thinking	76
Qwen3-8B-DMS-8x	medium	AIME 2024	qwen3-8b-base	nvidia	84	Qwen/Qwen3-8B	75
Qwen3-4B-AWQ	low	Unknown	qwen3-4b-base	Qwen	85	Qwen/Qwen3-4B	73.8
Magistral-Small-2506	low	Unknown	mistral-small-3-1-24b-instruct-2503	mistralai	86	mistralai/Mistral-Small-3.1-24B-Instruct-2503	73.59
Magistral-Small-2506-GGUF	low	Unknown	magistral-small-2506	unsloth	87	mistralai/Magistral-Small-2506	73.59
Magistral-Small-2506-GGUF	low	Unknown	mistral-small-3-1-24b-instruct-2503	Mungert	88	mistralai/Mistral-Small-3.1-24B-Instruct-2503	73.59
Magistral-Small-2506-unsloth-bnb-4bit	low	Unknown	magistral-small-2506	unsloth	89	mistralai/Magistral-Small-2506	73.59
Olmo-3-32B-Think	medium	AIME 2024	olmo-3-32b-think-dpo	allenai	90	allenai/Olmo-3-32B-Think-DPO	73.5
Olmo-3-32B-Think-SFT	medium	AIME 2024	olmo-3-1125-32b	allenai	91	allenai/Olmo-3-1125-32B	73.5
Olmo-3-32B-Think-GGUF	medium	AIME 2024	olmo-3-32b-think-dpo	unsloth	92	allenai/Olmo-3-32B-Think	73.5
Olmo-3-32B-Think-DPO	medium	AIME 2024	olmo-3-32b-think-sft	allenai	93	allenai/Olmo-3-32B-Think-SFT	73.5
Olmo-3-32B-Think-unsloth-bnb-4bit	medium	AIME 2024	olmo-3-32b-think-dpo	unsloth	94	allenai/Olmo-3-32B-Think	73.5
DeepSeek-R1-Distill-Qwen-32B	high	Unknown	deepseek-r1-distill-qwen-32b	deepseek-ai	95	deepseek-ai/DeepSeek-R1-Distill-Qwen-32B	72.6
DeepSeek-R1-Distill-Qwen-32B-GGUF	high	Unknown	deepseek-r1-distill-qwen-32b	unsloth	96	deepseek-ai/DeepSeek-R1-Distill-Qwen-32B	72.6
DeepSeek-R1-Distill-Qwen-32B-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-32b	unsloth	97	deepseek-ai/DeepSeek-R1-Distill-Qwen-32B	72.6
DeepSeek-R1-Distill-Qwen-32B	high	Unknown	deepseek-r1-distill-qwen-32b	unsloth	98	deepseek-ai/DeepSeek-R1-Distill-Qwen-32B	72.6
DeepSeek-R1-Distill-Qwen-32B-unsloth-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-32b	unsloth	99	deepseek-ai/DeepSeek-R1-Distill-Qwen-32B	72.6
DeepSeek-R1-Distill-Qwen-32B-GGUF	high	Unknown	deepseek-r1-distill-qwen-32b	Mungert	100	deepseek-ai/DeepSeek-R1-Distill-Qwen-32B	72.6
SynLogic-Mix-3-32B	low	Unknown	qwen2-5-32b	MiniMaxAI	101	Qwen/Qwen2.5-32B	72.6
Magistral-Small-2507	low	Unknown	mistral-small-3-1-24b-instruct-2503	mistralai	102	mistralai/Mistral-Small-3.1-24B-Instruct-2503	72.03
Magistral-Small-2507-GGUF	low	Unknown	Unknown	unsloth	103	mistralai/Magistral-Small-2507	72.03
AceReason-Nemotron-1.1-7B	low	Unknown	acereason-nemotron-1-1-7b	nvidia	104	nvidia/AceReason-Nemotron-1.1-7B	70.2
DeepSeek-R1-Distill-Llama-70B	high	Unknown	deepseek-r1-distill-llama-70b	deepseek-ai	105	deepseek-ai/DeepSeek-R1-Distill-Llama-70B	70
DeepSeek-R1-Distill-Llama-70B-GGUF	high	Unknown	deepseek-r1-distill-llama-70b	unsloth	106	deepseek-ai/DeepSeek-R1-Distill-Llama-70B	70
r1-1776-distill-llama-70b-GGUF	medium	AIME 2024	Unknown	unsloth	107	perplexity-ai/r1-1776-distill-llama-70b	70
DeepSeek-R1-Distill-Llama-70B-bnb-4bit	high	Unknown	deepseek-r1-distill-llama-70b	unsloth	108	deepseek-ai/DeepSeek-R1-Distill-Llama-70B	70
DeepSeek-R1-Distill-Llama-70B-GGUF	high	Unknown	deepseek-r1-distill-llama-70b	Mungert	109	deepseek-ai/DeepSeek-R1-Distill-Llama-70B	70
DeepSeek-R1-Distill-Llama-70B-unsloth-bnb-4bit	high	Unknown	deepseek-r1-distill-llama-70b	unsloth	110	deepseek-ai/DeepSeek-R1-Distill-Llama-70B	70
DeepSeek-R1-Distill-Llama-70B	high	Unknown	deepseek-r1-distill-llama-70b	unsloth	111	deepseek-ai/DeepSeek-R1-Distill-Llama-70B	70
DeepSeek-R1-Distill-Qwen-14B	high	Unknown	deepseek-r1-distill-qwen-14b	deepseek-ai	112	deepseek-ai/DeepSeek-R1-Distill-Qwen-14B	69.7
DeepSeek-R1-Distill-Qwen-14B-GGUF	high	Unknown	deepseek-r1-distill-qwen-14b	unsloth	113	deepseek-ai/DeepSeek-R1-Distill-Qwen-14B	69.7
DeepSeek-R1-Distill-Qwen-14B-unsloth-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-14b	unsloth	114	deepseek-ai/DeepSeek-R1-Distill-Qwen-14B	69.7
DeepSeek-R1-Distill-Qwen-14B-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-14b	unsloth	115	deepseek-ai/DeepSeek-R1-Distill-Qwen-14B	69.7
DeepSeek-R1-Distill-Qwen-14B	high	Unknown	deepseek-r1-distill-qwen-14b	unsloth	116	deepseek-ai/DeepSeek-R1-Distill-Qwen-14B	69.7
DeepSeek-R1-Distill-Qwen-14B-GGUF	high	Unknown	deepseek-r1-distill-qwen-14b	Mungert	117	deepseek-ai/DeepSeek-R1-Distill-Qwen-14B	69.7
Nemotron-Research-GooseReason-4B-Instruct	low	Unknown	qwen3-4b-instruct-2507	nvidia	118	Qwen/Qwen3-4B-Instruct-2507	64.79
NVIDIA-Nemotron-Nano-9B-v2-Base	medium	AIME 2024 avg@32	nvidia-nemotron-nano-9b-v2-base	nvidia	119	nvidia/NVIDIA-Nemotron-Nano-9B-v2-Base	56.67
NVIDIA-Nemotron-Nano-12B-v2-Base	medium	AIME 2024 avg@32	nvidia-nemotron-nano-12b-v2-base	nvidia	120	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	56.67
Ring-lite-distill-preview	high	Unknown	ling-lite	inclusionAI	121	inclusionAI/Ling-lite	56.3
DeepSeek-R1-Distill-Qwen-7B	high	Unknown	deepseek-r1-distill-qwen-7b	deepseek-ai	122	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	55.5
DeepSeek-R1-Distill-Qwen-7B-GGUF	high	Unknown	deepseek-r1-distill-qwen-7b	unsloth	123	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	55.5
OpenReasoning-Nemotron-32B	low	Unknown	qwen2-5-32b	nvidia	124	Qwen/Qwen2.5-32B	55.5
OpenReasoning-Nemotron-32B	medium	AIME24	qwen2-5-32b	nvidia	125	Qwen/Qwen2.5-32B	55.5
DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-7b	unsloth	126	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	55.5
DeepSeek-R1-Distill-Qwen-7B-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-7b	unsloth	127	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	55.5
OpenReasoning-Nemotron-1.5B	low	Unknown	qwen2-5-1-5b	nvidia	128	Qwen/Qwen2.5-1.5B	55.5
OpenReasoning-Nemotron-1.5B	medium	AIME24	qwen2-5-1-5b	nvidia	129	Qwen/Qwen2.5-1.5B	55.5
OpenReasoning-Nemotron-14B	low	Unknown	qwen2-5-14b	nvidia	130	Qwen/Qwen2.5-14B	55.5
OpenReasoning-Nemotron-14B	medium	AIME24	qwen2-5-14b	nvidia	131	Qwen/Qwen2.5-14B	55.5
OpenReasoning-Nemotron-7B	low	Unknown	qwen2-5-7b	nvidia	132	Qwen/Qwen2.5-7B	55.5
OpenReasoning-Nemotron-7B	medium	AIME24	qwen2-5-7b	nvidia	133	Qwen/Qwen2.5-7B	55.5
DeepSeek-R1-Distill-Qwen-7B	high	Unknown	deepseek-r1-distill-qwen-7b	unsloth	134	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	55.5
OpenReasoning-Nemotron-32B-GGUF	low	Unknown	qwen2-5-32b	unsloth	135	nvidia/OpenReasoning-Nemotron-32B	55.5
OpenReasoning-Nemotron-32B-GGUF	medium	AIME24	qwen2-5-32b	unsloth	136	nvidia/OpenReasoning-Nemotron-32B	55.5
OpenReasoning-Nemotron-7B-GGUF	low	Unknown	qwen2-5-7b-instruct	Mungert	137	Qwen/Qwen2.5-7B-Instruct	55.5
OpenReasoning-Nemotron-7B-GGUF	medium	AIME24	qwen2-5-7b-instruct	Mungert	138	Qwen/Qwen2.5-7B-Instruct	55.5
DeepSeek-R1-Distill-Qwen-7B-GGUF	high	Unknown	deepseek-r1-distill-qwen-7b	Mungert	139	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	55.5
OpenReasoning-Nemotron-1.5B-GGUF	low	Unknown	qwen2-5-1-5b-instruct	Mungert	140	Qwen/Qwen2.5-1.5B-Instruct	55.5
OpenReasoning-Nemotron-1.5B-GGUF	medium	AIME24	qwen2-5-1-5b-instruct	Mungert	141	Qwen/Qwen2.5-1.5B-Instruct	55.5
AceMath-RL-Nemotron-7B	low	Unknown	acemath-rl-nemotron-7b	nvidia	142	nvidia/AceMath-RL-Nemotron-7B	55.5
OpenReasoning-Nemotron-14B-GGUF	low	Unknown	qwen2-5-14b	Mungert	143	Qwen/Qwen2.5-14B-Instruct	55.5
OpenReasoning-Nemotron-14B-GGUF	medium	AIME24	qwen2-5-14b	Mungert	144	Qwen/Qwen2.5-14B-Instruct	55.5
OpenReasoning-Nemotron-32B-GGUF	low	Unknown	qwen2-5-32b-instruct	Mungert	145	Qwen/Qwen2.5-32B-Instruct	55.5
OpenReasoning-Nemotron-32B-GGUF	medium	AIME24	qwen2-5-32b-instruct	Mungert	146	Qwen/Qwen2.5-32B-Instruct	55.5
OREAL-DeepSeek-R1-Distill-Qwen-7B	high	Unknown	deepseek-r1-distill-qwen-7b	internlm	147	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	55.5
DistilQwen2.5-R1-3B	low	Unknown	Unknown	alibaba-pai	148	alibaba-pai/DistilQwen2.5-R1-3B	55.5
AceMath-RL-Nemotron-7B-GGUF	low	Unknown	acemath-rl-nemotron-7b	Mungert	149	nvidia/AceMath-RL-Nemotron-7B	55.5
Polaris-4B-Preview-GGUF	low	Unknown	qwen3-4b-base	Mungert	150	Qwen/Qwen3-4B	55
Polaris-7B-Preview-GGUF	low	Unknown	deepseek-r1-distill-qwen-7b	Mungert	151	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	55
Ring-lite-linear-preview	high	Unknown	ling-lite	inclusionAI	152	inclusionAI/Ling-lite	55
AReaL-boba-SFT-32B	low	Unknown	Unknown	inclusionAI	153	inclusionAI/AReaL-boba-SFT-32B	55
AReaL-boba-RL-7B	low	Unknown	Unknown	inclusionAI	154	inclusionAI/AReaL-boba-RL-7B	55
NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	medium	AIME 2024	nvidia-nemotron-3-super-120b-a12b-base-bf16	nvidia	155	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	53.33
DeepSeek-V3-0324-NVFP4	medium	AIME 2024	deepseek-v3-0324	nvidia	156	deepseek-ai/DeepSeek-V3-0324	52
DeepSeek-R1-Distill-Llama-8B	high	Unknown	deepseek-r1-distill-llama-8b	deepseek-ai	157	deepseek-ai/DeepSeek-R1-Distill-Llama-8B	50.4
DeepSeek-R1-Distill-Llama-8B-GGUF	high	Unknown	deepseek-r1-distill-llama-8b	unsloth	158	deepseek-ai/DeepSeek-R1-Distill-Llama-8B	50.4
DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit	high	Unknown	deepseek-r1-distill-llama-8b	unsloth	159	deepseek-ai/DeepSeek-R1-Distill-Llama-8B	50.4
DeepSeek-R1-Distill-Llama-8B	high	Unknown	deepseek-r1-distill-llama-8b	unsloth	160	deepseek-ai/DeepSeek-R1-Distill-Llama-8B	50.4
DeepSeek-R1-Distill-Llama-8B-bnb-4bit	high	Unknown	deepseek-r1-distill-llama-8b	unsloth	161	deepseek-ai/DeepSeek-R1-Distill-Llama-8B	50.4
DeepSeek-R1-Distill-Llama-8B-GGUF	high	Unknown	deepseek-r1-distill-llama-8b	Mungert	162	deepseek-ai/DeepSeek-R1-Distill-Llama-8B	50.4
Sky-T1-32B-Preview	medium	AIME2024	qwen2-5-32b-instruct	NovaSky-AI	163	Qwen/Qwen2.5-32B-Instruct	43.3
Sky-T1-32B-Flash	medium	AIME24	qwen2-5-32b-instruct	NovaSky-AI	164	Qwen/Qwen2.5-32B-Instruct	43.3
AReaL-1.5B-Preview-Stage-2	low	Unknown	Unknown	inclusionAI	165	inclusionAI/AReaL-1.5B-Preview-Stage-2	40
AReaL-1.5B-Preview-Stage-3	low	Unknown	Unknown	inclusionAI	166	inclusionAI/AReaL-1.5B-Preview-Stage-3	40
AReaL-1.5B-Preview-Stage-1	low	Unknown	Unknown	inclusionAI	167	inclusionAI/AReaL-1.5B-Preview-Stage-1	40
NFT-32B	medium	AIME24 (avg@32)	qwen2-5-32b	nvidia	168	Qwen/Qwen2.5-32B	37.8
ZR1-1.5B-GGUF	high	Unknown	deepseek-r1-distill-qwen-1-5b	Mungert	169	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	33.75
NFT-7B	medium	AIME24 (avg@32)	qwen2-5-math-7b	nvidia	170	Qwen/Qwen2.5-Math-7B	32
OpenThinker3-7B-GGUF	low	Unknown	qwen2-5-7b-instruct	Mungert	171	Qwen/Qwen2.5-7B-Instruct	30.7
SynLogic-7B	low	Unknown	qwen2-5-7b	MiniMaxAI	172	Qwen/Qwen2.5-7B	30
Phi-4-mini-flash-reasoning	low	Unknown	Unknown	microsoft	173	microsoft/Phi-4-mini-flash-reasoning	29.58
DeepSeek-R1-Distill-Qwen-1.5B	high	Unknown	deepseek-r1-distill-qwen-1-5b	deepseek-ai	174	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	28.9
DeepSeek-R1-Distill-Qwen-1.5B-GGUF	high	Unknown	deepseek-r1-distill-qwen-1-5b	unsloth	175	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	28.9
DeepSeek-R1-Distill-Qwen-1.5B-unsloth-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-1-5b	unsloth	176	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	28.9
DeepSeek-R1-Distill-Qwen-1.5B-bnb-4bit	high	Unknown	deepseek-r1-distill-qwen-1-5b	unsloth	177	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	28.9
DeepSeek-R1-Distill-Qwen-1.5B	high	Unknown	deepseek-r1-distill-qwen-1-5b	unsloth	178	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	28.9
DeepSeek-R1-Distill-Qwen-1.5B-GGUF	high	Unknown	deepseek-r1-distill-qwen-1-5b	Mungert	179	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	28.9
Nemotron-Research-Reasoning-Qwen-1.5B	low	Unknown	deepseek-r1-distill-qwen-1-5b	nvidia	180	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	28.54
Nemotron-Research-Reasoning-Qwen-1.5B-GGUF	low	Unknown	deepseek-r1-distill-qwen-1-5b	Mungert	181	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	28.54
Ling-lite-1.5	medium	AIME2024(pass@1)	ling-lite-1-5	inclusionAI	182	inclusionAI/Ling-lite-1.5	21.88
OREAL-7B	low	Unknown	oreal-7b-sft	internlm	183	internlm/OREAL-7B-SFT	16.7
OREAL-32B	low	Unknown	oreal-32b-sft	internlm	184	internlm/OREAL-32B-SFT	16.7
OREAL-7B-SFT	low	Unknown	qwen2-5-7b	internlm	185	Qwen/Qwen2.5-7B	16.7
Ling-lite	medium	AIME2024(pass@1)	ling-lite	inclusionAI	186	inclusionAI/Ling-lite	13.33
DeepScaleR-1.5B-Preview-unsloth-bnb-4bit	low	Unknown	deepscaler-1-5b-preview	unsloth	187	agentica-org/DeepScaleR-1.5B-Preview	13.3
Olmo-3.1-32B-Instruct	medium	AIME 2024	olmo-3-1-32b-instruct-dpo	allenai	188	allenai/Olmo-3.1-32B-Instruct-DPO	12.7
Olmo-3.1-32B-Instruct-SFT	medium	AIME 2024	olmo-3-1125-32b	allenai	189	allenai/Olmo-3-1125-32B	12.7
Olmo-3.1-32B-Instruct-DPO	medium	AIME 2024	olmo-3-1-32b-instruct-sft	allenai	190	allenai/Olmo-3.1-32B-Instruct-SFT	12.7
Olmo-3.1-32B-Instruct-GGUF	medium	AIME 2024	olmo-3-1-32b-instruct	unsloth	191	allenai/Olmo-3.1-32B-Instruct	12.7
Olmo-3.1-32B-Instruct	medium	AIME 2024	olmo-3-1-32b-instruct	unsloth	192	allenai/Olmo-3.1-32B-Instruct	12.7
DeepSeek-R1	low	Unknown	deepseek-r1	deepseek-ai	193	deepseek-ai/DeepSeek-R1	9.3
DeepSeek-R1-GGUF	low	Unknown	deepseek-r1	unsloth	194	deepseek-ai/DeepSeek-R1	9.3
DeepSeek-R1-Zero	low	Unknown	deepseek-r1-zero	deepseek-ai	195	deepseek-ai/DeepSeek-R1-Zero	9.3
DeepSeek-R1-BF16	low	Unknown	deepseek-r1	unsloth	196	deepseek-ai/DeepSeek-R1	9.3
DeepSeek-R1-GGUF-UD	low	Unknown	deepseek-r1	unsloth	197	deepseek-ai/DeepSeek-R1	9.3
DeepSeek-R1-Zero-GGUF	low	Unknown	deepseek-r1-zero	unsloth	198	deepseek-ai/DeepSeek-R1-Zero	9.3
DeepSeek-R1	low	Unknown	deepseek-r1	unsloth	199	deepseek-ai/DeepSeek-R1	9.3

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/aime-2024.html
url: huggingface.co/spaces/aime ↗