Leaderboard

IFEval

if-eval

Record

Category: instruction-following
Scored models: 318

Scores

Model	Score
LiquidAI/LFM2-1.2B	98.85
google/gemma-4-26B-A4B-it	96.6
google/diffusiongemma-26B-A4B-it	94.01
allenai/Olmo-3-32B-Think-DPO	93.8
allenai/Olmo-3.1-32B-Think	93.8
nvidia/NVIDIA-Nemotron-Nano-9B-v2	92
nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	92
nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	92
nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	92
nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	92
LiquidAI/LFM2.5-8B-A1B	91.84
LiquidAI/LFM2.5-8B-A1B	91.84
LiquidAI/LFM2.5-8B-A1B-Base	91.84
MiniMaxAI/MiniMax-M2.7	90.4
Qwen/Qwen3-8B	90.3
nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	89.81
nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	89.81
Qwen/Qwen3-30B-A3B-Thinking-2507	89.8
Qwen/Qwen3-30B-A3B-Thinking-2507	89.8
Qwen/Qwen3-30B-A3B-Thinking-2507	89.8
Qwen/Qwen3-30B-A3B-Thinking-2507	89.8
Qwen/Qwen3-30B-A3B-Thinking-2507	89.8
nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	89.4
nvidia/NVIDIA-Nemotron-Nano-9B-v2	89.4

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: instruction-following
id: if-eval
name: IFEval
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
LFM2-Audio-1.5B	high	Unknown	lfm2-1-2b	LiquidAI	1	LiquidAI/LFM2-1.2B	98.85
Gemma-4-26B-A4B-NVFP4	medium	IFEval	gemma-4-26b-a4b-it	nvidia	2	google/gemma-4-26B-A4B-it	96.6
diffusiongemma-26B-A4B-it-NVFP4	medium	IFEval	diffusiongemma-26b-a4b-it	nvidia	3	google/diffusiongemma-26B-A4B-it	94.01
Olmo-3.1-32B-Think	medium	IFEval	olmo-3-32b-think-dpo	allenai	4	allenai/Olmo-3-32B-Think-DPO	93.8
Olmo-3.1-32B-Think-GGUF	medium	IFEval	olmo-3-1-32b-think	unsloth	5	allenai/Olmo-3.1-32B-Think	93.8
NVIDIA-Nemotron-3-Nano-4B-BF16	medium	IFEVAL-Instruction	nvidia-nemotron-nano-12b-v2-base	nvidia	6	nvidia/NVIDIA-Nemotron-Nano-9B-v2	92
NVIDIA-Nemotron-3-Nano-4B-FP8	medium	IFEVAL-Instruction	nvidia-nemotron-nano-9b-v2	nvidia	7	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	92
NVIDIA-Nemotron-3-Nano-4B	medium	IFEVAL-Instruction	nvidia-nemotron-nano-9b-v2	unsloth	8	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	92
NVIDIA-Nemotron-3-Nano-4B-GGUF	medium	IFEVAL-Instruction	nvidia-nemotron-nano-9b-v2	unsloth	9	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	92
NVIDIA-Nemotron-3-Nano-4B-FP8	medium	IFEVAL-Instruction	nvidia-nemotron-nano-9b-v2	unsloth	10	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	92
LFM2.5-8B-A1B-GGUF	high	Unknown	lfm2-5-8b-a1b	unsloth	11	LiquidAI/LFM2.5-8B-A1B	91.84
LFM2.5-8B-A1B	high	Unknown	lfm2-5-8b-a1b	unsloth	12	LiquidAI/LFM2.5-8B-A1B	91.84
LFM2.5-8B-A1B-GGUF	high	Unknown	lfm2-5-8b-a1b-base	Mungert	13	LiquidAI/LFM2.5-8B-A1B-Base	91.84
MiniMax-M2.7-NVFP4	high	Unknown	minimax-m2-7	nvidia	14	MiniMaxAI/MiniMax-M2.7	90.4
Qwen3-8B-DMS-8x	medium	IFEval	qwen3-8b-base	nvidia	15	Qwen/Qwen3-8B	90.3
NVIDIA-Nemotron-Nano-12B-v2	medium	IFEVAL-Instruction	nvidia-nemotron-nano-12b-v2-base	nvidia	16	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	89.81
NVIDIA-Nemotron-Nano-12B-v2-GGUF	medium	IFEVAL-Instruction	nvidia-nemotron-nano-12b-v2-base	Mungert	17	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	89.81
Qwen3-30B-A3B-Thinking-2507	medium	IFEval	qwen3-30b-a3b-thinking-2507	Qwen	18	Qwen/Qwen3-30B-A3B-Thinking-2507	89.8
Qwen3-30B-A3B-Thinking-2507-FP8	medium	IFEval	qwen3-30b-a3b-thinking-2507	Qwen	19	Qwen/Qwen3-30B-A3B-Thinking-2507	89.8
Qwen3-30B-A3B-Thinking-2507-GGUF	medium	IFEval	qwen3-30b-a3b-thinking-2507	unsloth	20	Qwen/Qwen3-30B-A3B-Thinking-2507	89.8
Qwen3-30B-A3B-Thinking-2507-GGUF	medium	IFEval	qwen3-30b-a3b-thinking-2507	Mungert	21	Qwen/Qwen3-30B-A3B-Thinking-2507	89.8
Qwen3-30B-A3B-Thinking-2507	medium	IFEval	qwen3-30b-a3b-thinking-2507	unsloth	22	Qwen/Qwen3-30B-A3B-Thinking-2507	89.8
NVIDIA-Nemotron-Nano-9B-v2	medium	IFEval (Instruction Strict)	nvidia-nemotron-nano-12b-v2-base	nvidia	23	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	89.4
NVIDIA-Nemotron-Nano-9B-v2-FP8	medium	IFEval (Instruction Strict)	nvidia-nemotron-nano-12b-v2-base	nvidia	24	nvidia/NVIDIA-Nemotron-Nano-9B-v2	89.4
NVIDIA-Nemotron-Nano-9B-v2-NVFP4	medium	IFEval (Instruction Strict)	nvidia-nemotron-nano-12b-v2-base	nvidia	25	nvidia/NVIDIA-Nemotron-Nano-9B-v2	89.4
NVIDIA-Nemotron-Nano-9B-v2	medium	IFEval (Instruction Strict)	nvidia-nemotron-nano-12b-v2-base	unsloth	26	nvidia/NVIDIA-Nemotron-Nano-9B-v2	89.4
Falcon-H1-34B-Instruct	medium	IFEval	falcon-h1-34b-base	tiiuae	27	tiiuae/Falcon-H1-34B-Base	89.37
Falcon-H1-34B-Instruct-GGUF	medium	IFEval	falcon-h1-34b-instruct	tiiuae	28	tiiuae/Falcon-H1-34B-Instruct	89.37
Falcon-H1-34B-Instruct-GGUF	medium	IFEval	falcon-h1-34b-instruct	unsloth	29	tiiuae/Falcon-H1-34B-Instruct	89.37
Falcon-H1-34B-Instruct-GPTQ-Int4	medium	IFEval	falcon-h1-34b-instruct	tiiuae	30	tiiuae/Falcon-H1-34B-Instruct	89.37
Nex-N2-mini-GGUF	medium	IFEval	nex-n2-mini	Mungert	31	nex-agi/Nex-N2-mini	89.1
Qwen3-Next-80B-A3B-Thinking	medium	IFEval	qwen3-next-80b-a3b-thinking	Qwen	32	Qwen/Qwen3-Next-80B-A3B-Thinking	88.9
Qwen3-Next-80B-A3B-Thinking-FP8	medium	IFEval	qwen3-next-80b-a3b-thinking	Qwen	33	Qwen/Qwen3-Next-80B-A3B-Thinking	88.9
Qwen3-Next-80B-A3B-Thinking-GGUF	medium	IFEval	qwen3-next-80b-a3b-thinking	unsloth	34	Qwen/Qwen3-Next-80B-A3B-Thinking	88.9
Qwen3-Next-80B-A3B-Thinking-GGUF	medium	IFEval	qwen3-next-80b-a3b-thinking	Qwen	35	Qwen/Qwen3-Next-80B-A3B-Thinking	88.9
Qwen3-Next-80B-A3B-Thinking	medium	IFEval	qwen3-next-80b-a3b-thinking	unsloth	36	Qwen/Qwen3-Next-80B-A3B-Thinking	88.9
NVIDIA-Nemotron-3-Nano-4B-BF16	medium	IFEval-Instruction	nvidia-nemotron-nano-12b-v2-base	nvidia	37	nvidia/NVIDIA-Nemotron-Nano-9B-v2	88
NVIDIA-Nemotron-3-Nano-4B-FP8	medium	IFEval-Instruction	nvidia-nemotron-nano-9b-v2	nvidia	38	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	88
NVIDIA-Nemotron-3-Nano-4B-GGUF	medium	IFEval-Instruction	nvidia-nemotron-3-nano-4b-fp8	nvidia	39	nvidia/NVIDIA-Nemotron-3-Nano-4B-FP8	88
NVIDIA-Nemotron-3-Nano-4B	medium	IFEval-Instruction	nvidia-nemotron-nano-9b-v2	unsloth	40	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	88
NVIDIA-Nemotron-3-Nano-4B-GGUF	medium	IFEval-Instruction	nvidia-nemotron-nano-9b-v2	unsloth	41	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	88
NVIDIA-Nemotron-3-Nano-4B-FP8	medium	IFEval-Instruction	nvidia-nemotron-nano-9b-v2	unsloth	42	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	88
NVIDIA-Nemotron-3-Nano-4B-BF16	medium	IFEVAL-Prompt	nvidia-nemotron-nano-12b-v2-base	nvidia	43	nvidia/NVIDIA-Nemotron-Nano-9B-v2	87.9
NVIDIA-Nemotron-3-Nano-4B-FP8	medium	IFEVAL-Prompt	nvidia-nemotron-nano-9b-v2	nvidia	44	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	87.9
NVIDIA-Nemotron-3-Nano-4B	medium	IFEVAL-Prompt	nvidia-nemotron-nano-9b-v2	unsloth	45	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	87.9
NVIDIA-Nemotron-3-Nano-4B-GGUF	medium	IFEVAL-Prompt	nvidia-nemotron-nano-9b-v2	unsloth	46	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	87.9
NVIDIA-Nemotron-3-Nano-4B-FP8	medium	IFEVAL-Prompt	nvidia-nemotron-nano-9b-v2	unsloth	47	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	87.9
Olmo-3.1-32B-Instruct	medium	IFEval	olmo-3-1-32b-instruct-dpo	allenai	48	allenai/Olmo-3.1-32B-Instruct-DPO	87.7
Olmo-3.1-32B-Instruct-SFT	medium	IFEval	olmo-3-1125-32b	allenai	49	allenai/Olmo-3-1125-32B	87.7
Olmo-3.1-32B-Instruct-DPO	medium	IFEval	olmo-3-1-32b-instruct-sft	allenai	50	allenai/Olmo-3.1-32B-Instruct-SFT	87.7
Olmo-3.1-32B-Instruct-GGUF	medium	IFEval	olmo-3-1-32b-instruct	unsloth	51	allenai/Olmo-3.1-32B-Instruct	87.7
Olmo-3.1-32B-Instruct	medium	IFEval	olmo-3-1-32b-instruct	unsloth	52	allenai/Olmo-3.1-32B-Instruct	87.7
GLM-4-32B-0414	high	Unknown	glm-4-32b-0414	zai-org	53	zai-org/GLM-4-32B-0414	87.6
GLM-4-32B-0414-GGUF	high	Unknown	Unknown	unsloth	54	THUDM/GLM-4-32B-0414	87.6
Nemotron-H-47B-Reasoning-128K	medium	IFEVAL-Instruction	nemotron-h-47b-reasoning-128k	nvidia	55	nvidia/Nemotron-H-47B-Reasoning-128K	87.4
Nemotron-H-47B-Reasoning-128K-FP8	medium	IFEVAL-Instruction	nemotron-h-47b-reasoning-128k	nvidia	56	nvidia/Nemotron-H-47B-Reasoning-128K	87.4
LLaDA2.0-mini	medium	IFEval-strict -prompt	llada2-0-mini	inclusionAI	57	inclusionAI/LLaDA2.0-mini	86.9
Qwen3-4B-Thinking-2507	medium	IFEval	qwen3-4b-thinking-2507	Qwen	58	Qwen/Qwen3-4B-Thinking-2507	86.5
Qwen3-4B-Thinking-2507-FP8	medium	IFEval	qwen3-4b-thinking-2507	Qwen	59	Qwen/Qwen3-4B-Thinking-2507	86.5
Qwen3-4B-Thinking-2507-unsloth-bnb-4bit	medium	IFEval	qwen3-4b-thinking-2507	unsloth	60	Qwen/Qwen3-4B-Thinking-2507	86.5
Qwen3-4B-Thinking-2507-GGUF	medium	IFEval	qwen3-4b-thinking-2507	unsloth	61	Qwen/Qwen3-4B-Thinking-2507	86.5
Qwen3-4B-Thinking-2507	medium	IFEval	qwen3-4b-thinking-2507	unsloth	62	Qwen/Qwen3-4B-Thinking-2507	86.5
Qwen3-4B-Thinking-2507-bnb-4bit	medium	IFEval	qwen3-4b-thinking-2507	unsloth	63	Qwen/Qwen3-4B-Thinking-2507	86.5
Qwen3-4B-Thinking-2507-FP8	medium	IFEval	qwen3-4b-thinking-2507-fp8	unsloth	64	Qwen/Qwen3-4B-Thinking-2507-FP8	86.5
Qwen3-4B-Thinking-2507-GGUF	medium	IFEval	qwen3-4b-thinking-2507	Mungert	65	Qwen/Qwen3-4B-Thinking-2507	86.5
LFM2.5-1.2B-Instruct-GGUF	low	Unknown	lfm2-5-1-2b-base	unsloth	66	LiquidAI/LFM2.5-1.2B-Instruct	86.23
LFM2.5-1.2B-Instruct	low	Unknown	lfm2-5-1-2b-base	unsloth	67	LiquidAI/LFM2.5-1.2B-Instruct	86.23
LFM2.5-1.2B-Thinking-GGUF	low	Unknown	lfm2-5-1-2b-thinking	unsloth	68	LiquidAI/LFM2.5-1.2B-Thinking	86.23
LFM2.5-1.2B-Instruct-GGUF	low	Unknown	lfm2-5-1-2b-base	Mungert	69	LiquidAI/LFM2.5-1.2B-Base	86.23
LFM2.5-1.2B-Thinking-GGUF	low	Unknown	lfm2-5-1-2b-base	Mungert	70	LiquidAI/LFM2.5-1.2B-Base	86.23
SmallThinker-21BA3B-Instruct-GGUF	low	Unknown	Unknown	Mungert	71	—	85.77
GLM-4-9B-0414	low	Unknown	glm-4-9b-0414	zai-org	72	zai-org/GLM-4-9B-0414	85.6
GLM-4-9B-0414-GGUF	low	Unknown	glm-4-9b-0414	unsloth	73	THUDM/GLM-4-9B-0414	85.6
GLM-4-32B-Base-0414	low	Unknown	glm-4-32b-base-0414	zai-org	74	zai-org/GLM-4-32B-Base-0414	85.6
GLM-4-9B-0414-unsloth-bnb-4bit	low	Unknown	glm-4-9b-0414	unsloth	75	THUDM/GLM-4-9B-0414	85.6
GLM-4-9B-0414	low	Unknown	glm-4-9b-0414	unsloth	76	THUDM/GLM-4-9B-0414	85.6
GLM-4-9B-0414-bnb-4bit	low	Unknown	glm-4-9b-0414	unsloth	77	THUDM/GLM-4-9B-0414	85.6
Nemotron-Cascade-14B-Thinking	medium	IFEval (Strict Prompt)	nemotron-cascade-14b-thinking	nvidia	78	nvidia/Nemotron-Cascade-14B-Thinking	85.4
Falcon-H1-7B-Instruct	medium	IFEval	falcon-h1-7b-base	tiiuae	79	tiiuae/Falcon-H1-7B-Base	85.35
Falcon-H1-7B-Instruct-GPTQ-Int4	medium	IFEval	falcon-h1-7b-instruct	tiiuae	80	tiiuae/Falcon-H1-7B-Instruct	85.35
Falcon-H1-7B-Instruct-GGUF	medium	IFEval	falcon-h1-7b-instruct	tiiuae	81	tiiuae/Falcon-H1-7B-Instruct	85.35
Falcon-H1-7B-Instruct-GGUF	medium	IFEval	falcon-h1-7b-instruct	unsloth	82	tiiuae/Falcon-H1-7B-Instruct	85.35
Falcon-H1-3B-Instruct	medium	IFEval	falcon-h1-3b-base	tiiuae	83	tiiuae/Falcon-H1-3B-Base	85.05
Falcon-H1-3B-Instruct-GGUF	medium	IFEval	falcon-h1-3b-base	tiiuae	84	tiiuae/Falcon-H1-3B-Base	85.05
Falcon-H1-3B-Instruct-GGUF	medium	IFEval	falcon-h1-3b-instruct	unsloth	85	tiiuae/Falcon-H1-3B-Instruct	85.05
Nemotron-Cascade-8B	medium	IFEval (Strict Prompt)	nemotron-cascade-8b	nvidia	86	nvidia/Nemotron-Cascade-8B	85
Nemotron-Cascade-8B-Thinking	medium	IFEval (Strict Prompt)	nemotron-cascade-8b-thinking	nvidia	87	nvidia/Nemotron-Cascade-8B-Thinking	85
NVIDIA-Nemotron-Nano-12B-v2	medium	IFEVAL-Prompt	nvidia-nemotron-nano-12b-v2-base	nvidia	88	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	84.7
Qwen3-Next-80B-A3B-Instruct-FP8	medium	IFEval	qwen3-next-80b-a3b-instruct	Qwen	89	Qwen/Qwen3-Next-80B-A3B-Instruct	84.7
Qwen3-Next-80B-A3B-Instruct	medium	IFEval	qwen3-next-80b-a3b-instruct	Qwen	90	Qwen/Qwen3-Next-80B-A3B-Instruct	84.7
Qwen3-Next-80B-A3B-Instruct-GGUF	medium	IFEval	qwen3-next-80b-a3b-instruct	Qwen	91	Qwen/Qwen3-Next-80B-A3B-Instruct	84.7
Qwen3-Next-80B-A3B-Instruct-GGUF	medium	IFEval	qwen3-next-80b-a3b-instruct	unsloth	92	Qwen/Qwen3-Next-80B-A3B-Instruct	84.7
Qwen3-Next-80B-A3B-Instruct-bnb-4bit	medium	IFEval	qwen3-next-80b-a3b-instruct	unsloth	93	Qwen/Qwen3-Next-80B-A3B-Instruct	84.7
NVIDIA-Nemotron-Nano-12B-v2-GGUF	medium	IFEVAL-Prompt	nvidia-nemotron-nano-12b-v2-base	Mungert	94	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	84.7
Qwen3-Next-80B-A3B-Instruct	medium	IFEval	qwen3-next-80b-a3b-instruct	unsloth	95	Qwen/Qwen3-Next-80B-A3B-Instruct	84.7
LLaDA2.0-flash	medium	IFEval-strict -prompt	llada2-0-flash	inclusionAI	96	inclusionAI/LLaDA2.0-flash	84.29
MiniMax-Text-01-hf	medium	IFEval _(avg)_	minimax-text-01-hf	MiniMaxAI	97	MiniMaxAI/MiniMax-Text-01-hf	84.1
MiniMax-Text-01	medium	IFEval _(avg)_	minimax-text-01	MiniMaxAI	98	MiniMaxAI/MiniMax-Text-01	84.1
Olmo-3-32B-Think	medium	IFEval	olmo-3-32b-think-dpo	allenai	99	allenai/Olmo-3-32B-Think-DPO	83.9
Olmo-3-32B-Think-SFT	medium	IFEval	olmo-3-1125-32b	allenai	100	allenai/Olmo-3-1125-32B	83.9
Olmo-3-32B-Think-GGUF	medium	IFEval	olmo-3-32b-think-dpo	unsloth	101	allenai/Olmo-3-32B-Think	83.9
Olmo-3-32B-Think-DPO	medium	IFEval	olmo-3-32b-think-sft	allenai	102	allenai/Olmo-3-32B-Think-SFT	83.9
Olmo-3-32B-Think-unsloth-bnb-4bit	medium	IFEval	olmo-3-32b-think-dpo	unsloth	103	allenai/Olmo-3-32B-Think	83.9
Falcon-H1-1.5B-Deep-Instruct	medium	IFEval	falcon-h1-1-5b-deep-base	tiiuae	104	tiiuae/Falcon-H1-1.5B-Deep-Base	83.5
Falcon-H1-1.5B-Deep-Instruct-GGUF	medium	IFEval	falcon-h1-1-5b-deep-instruct	tiiuae	105	tiiuae/Falcon-H1-1.5B-Deep-Instruct	83.5
Falcon-H1-1.5B-Deep-Instruct-GGUF	medium	IFEval	falcon-h1-1-5b-deep-instruct	unsloth	106	tiiuae/Falcon-H1-1.5B-Deep-Instruct	83.5
Falcon-H1-1.5B-Deep-Instruct	medium	IFEval	falcon-h1-1-5b-deep-instruct	unsloth	107	tiiuae/Falcon-H1-1.5B-Deep-Instruct	83.5
Falcon-H1-1.5B-Deep-Instruct-GPTQ-Int4	medium	IFEval	falcon-h1-1-5b-deep-instruct	tiiuae	108	tiiuae/Falcon-H1-1.5B-Deep-Instruct	83.5
Mistral-Small-24B-Instruct-2501	medium	ifeval	mistral-small-24b-base-2501	mistralai	109	mistralai/Mistral-Small-24B-Base-2501	82.9
Mistral-Small-24B-Instruct-2501-bnb-4bit	medium	ifeval	mistral-small-24b-instruct-2501	unsloth	110	mistralai/Mistral-Small-24B-Instruct-2501	82.9
Mistral-Small-24B-Instruct-2501-GGUF	medium	ifeval	mistral-small-24b-instruct-2501	unsloth	111	mistralai/Mistral-Small-24B-Instruct-2501	82.9
Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit	medium	ifeval	mistral-small-24b-instruct-2501	unsloth	112	mistralai/Mistral-Small-24B-Instruct-2501	82.9
Mistral-Small-24B-Instruct-2501	medium	ifeval	mistral-small-24b-instruct-2501	unsloth	113	mistralai/Mistral-Small-24B-Instruct-2501	82.9
Mistral-Small-24B-Base-2501-unsloth-bnb-4bit	medium	ifeval	mistral-small-24b-base-2501	unsloth	114	mistralai/Mistral-Small-24B-Base-2501	82.9
NVIDIA-Nemotron-3-Nano-4B-BF16	medium	IFEval-Prompt	nvidia-nemotron-nano-12b-v2-base	nvidia	115	nvidia/NVIDIA-Nemotron-Nano-9B-v2	82.8
NVIDIA-Nemotron-3-Nano-4B-FP8	medium	IFEval-Prompt	nvidia-nemotron-nano-9b-v2	nvidia	116	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	82.8
NVIDIA-Nemotron-3-Nano-4B-GGUF	medium	IFEval-Prompt	nvidia-nemotron-3-nano-4b-fp8	nvidia	117	nvidia/NVIDIA-Nemotron-3-Nano-4B-FP8	82.8
NVIDIA-Nemotron-3-Nano-4B	medium	IFEval-Prompt	nvidia-nemotron-nano-9b-v2	unsloth	118	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	82.8
NVIDIA-Nemotron-3-Nano-4B-GGUF	medium	IFEval-Prompt	nvidia-nemotron-nano-9b-v2	unsloth	119	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	82.8
NVIDIA-Nemotron-3-Nano-4B-FP8	medium	IFEval-Prompt	nvidia-nemotron-nano-9b-v2	unsloth	120	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	82.8
Llama-3.1-Tulu-3-8B	medium	IFEval (0-Shot)	llama-3-1-tulu-3-8b-dpo	allenai	121	allenai/Llama-3.1-Tulu-3-8B-DPO	82.55
Qwen3-30B-A3B-Instruct-2507	medium	IFEval	qwen3-30b-a3b-instruct-2507	Qwen	122	Qwen/Qwen3-30B-A3B-Instruct-2507	82.3
Qwen3-30B-A3B-Instruct-2507-FP8	medium	IFEval	qwen3-30b-a3b-instruct-2507	Qwen	123	Qwen/Qwen3-30B-A3B-Instruct-2507	82.3
Qwen3-30B-A3B-Instruct-2507-GGUF	medium	IFEval	qwen3-30b-a3b-instruct-2507	unsloth	124	Qwen/Qwen3-30B-A3B-Instruct-2507	82.3
Qwen3-235B-A22B-Instruct-2507-FP8	medium	IFEval	qwen3-235b-a22b-instruct-2507	Qwen	125	Qwen/Qwen3-235B-A22B-Instruct-2507	82.3
Qwen3-235B-A22B-Instruct-2507	medium	IFEval	qwen3-235b-a22b-instruct-2507	Qwen	126	Qwen/Qwen3-235B-A22B-Instruct-2507	82.3
Qwen3-235B-A22B-Instruct-2507-GGUF	medium	IFEval	qwen3-235b-a22b-instruct-2507	unsloth	127	Qwen/Qwen3-235B-A22B-Instruct-2507	82.3
Qwen3-30B-A3B-Instruct-2507	medium	IFEval	qwen3-30b-a3b-instruct-2507	unsloth	128	Qwen/Qwen3-30B-A3B-Instruct-2507	82.3
Qwen3-30B-A3B-Instruct-2507-GGUF	medium	IFEval	qwen3-30b-a3b-instruct-2507	Mungert	129	Qwen/Qwen3-30B-A3B-Instruct-2507	82.3
Qwen3-235B-A22B-Instruct-2507-FP8	medium	IFEval	qwen3-235b-a22b-instruct-2507-fp8	unsloth	130	Qwen/Qwen3-235B-A22B-Instruct-2507-FP8	82.3
Nemotron-H-47B-Reasoning-128K	medium	IFEVAL-Prompt	nemotron-h-47b-reasoning-128k	nvidia	131	nvidia/Nemotron-H-47B-Reasoning-128K	81.8
Nemotron-H-47B-Reasoning-128K-FP8	medium	IFEVAL-Prompt	nemotron-h-47b-reasoning-128k	nvidia	132	nvidia/Nemotron-H-47B-Reasoning-128K	81.8
LLaDA2.0-flash-preview	medium	IFEval-strict -prompt	llada2-0-flash-preview	inclusionAI	133	inclusionAI/LLaDA2.0-flash-preview	81.52
INTELLECT-2-GGUF	high	Unknown	intellect-2	unsloth	134	PrimeIntellect/INTELLECT-2	81.5
Ling-lite	medium	IFEval(Prompt Strict)	ling-lite	inclusionAI	135	inclusionAI/Ling-lite	81.09
Falcon-H1-1.5B-Instruct	medium	IFEval	falcon-h1-1-5b-base	tiiuae	136	tiiuae/Falcon-H1-1.5B-Base	80.66
Falcon-H1-1.5B-Instruct-GGUF	medium	IFEval	falcon-h1-1-5b-instruct	tiiuae	137	tiiuae/Falcon-H1-1.5B-Instruct	80.66
Falcon-H1-1.5B-Instruct-GGUF	medium	IFEval	falcon-h1-1-5b-instruct	unsloth	138	tiiuae/Falcon-H1-1.5B-Instruct	80.66
Falcon-H1-1.5B-Instruct-GPTQ-Int4	medium	IFEval	falcon-h1-1-5b-instruct	tiiuae	139	tiiuae/Falcon-H1-1.5B-Instruct	80.66
Falcon-H1-1.5B-Instruct-GPTQ-Int8	medium	IFEval	falcon-h1-1-5b-instruct	tiiuae	140	tiiuae/Falcon-H1-1.5B-Instruct	80.66
Llama-3.1-Tulu-3-70B-SFT	medium	IFEval (0-Shot)	llama-3-1-70b	allenai	141	meta-llama/Llama-3.1-70B	80.51
gemma-3-270m	medium	[IFEval][ifeval]	gemma-3-270m	google	142	google/gemma-3-270m	80.2
gemma-3-270m-it	medium	[IFEval][ifeval]	gemma-3-270m	google	143	google/gemma-3-270m	80.2
gemma-3-270m-it-GGUF	medium	[IFEval][ifeval]	gemma-3-270m-it	unsloth	144	google/gemma-3-270m-it	80.2
gemma-3-270m-it	medium	[IFEval][ifeval]	gemma-3-270m-it	unsloth	145	google/gemma-3-270m-it	80.2
gemma-3-270m-it-unsloth-bnb-4bit	medium	[IFEval][ifeval]	gemma-3-270m-it	unsloth	146	google/gemma-3-270m-it	80.2
gemma-3-270m-it-qat-GGUF	medium	[IFEval][ifeval]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	147	google/gemma-3-270m-it-qat-q4_0-unquantized	80.2
gemma-3-270m	medium	[IFEval][ifeval]	gemma-3-270m	unsloth	148	google/gemma-3-270m	80.2
gemma-3-270m-unsloth-bnb-4bit	medium	[IFEval][ifeval]	gemma-3-270m-it	unsloth	149	google/gemma-3-270m-it	80.2
gemma-3-270m-it-qat-q4_0-unquantized	medium	[IFEval][ifeval]	gemma-3-270m-it	google	150	google/gemma-3-270m-it	80.2
gemma-3-270m-it-bnb-4bit	medium	[IFEval][ifeval]	gemma-3-270m-it	unsloth	151	google/gemma-3-270m-it	80.2
gemma-3-270m-it-qat	medium	[IFEval][ifeval]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	152	google/gemma-3-270m-it-qat-q4_0-unquantized	80.2
gemma-3-270m-bnb-4bit	medium	[IFEval][ifeval]	gemma-3-270m	unsloth	153	google/gemma-3-270m	80.2
gemma-3-270m-qat-q4_0-unquantized	medium	[IFEval][ifeval]	gemma-3-270m	google	154	google/gemma-3-270m	80.2
gemma-3-270m-it-GGUF	medium	[IFEval][ifeval]	gemma-3-270m	Mungert	155	google/gemma-3-270m	80.2
gemma-3-270m-it-torchao-FP8	medium	[IFEval][ifeval]	gemma-3-270m-it	unsloth	156	google/gemma-3-270m-it	80.2
LFM2-2.6B-GGUF	high	Unknown	lfm2-2-6b	Mungert	157	LiquidAI/LFM2-2.6B	79.56
LFM2.5-8B-A1B-GGUF	medium	IFEval	lfm2-5-8b-a1b	unsloth	158	LiquidAI/LFM2.5-8B-A1B	79.44
LFM2.5-8B-A1B	medium	IFEval	lfm2-5-8b-a1b	unsloth	159	LiquidAI/LFM2.5-8B-A1B	79.44
LFM2.5-8B-A1B-GGUF	medium	IFEval	lfm2-5-8b-a1b-base	Mungert	160	LiquidAI/LFM2.5-8B-A1B-Base	79.44
Nemotron-H-8B-Reasoning-128K	medium	IFEVAL-Ins.	nemotron-h-8b-reasoning-128k	nvidia	161	nvidia/Nemotron-H-8B-Reasoning-128K	79.3
Nemotron-H-8B-Reasoning-128K-FP8	medium	IFEVAL-Ins.	nemotron-h-8b-reasoning-128k	nvidia	162	nvidia/Nemotron-H-8B-Reasoning-128K	79.3
Qwen3-235B-A22B-Thinking-2507-FP8	medium	IFEval	qwen3-235b-a22b-thinking-2507	Qwen	163	Qwen/Qwen3-235B-A22B-Thinking-2507	79.1
Qwen3-235B-A22B-Thinking-2507	medium	IFEval	qwen3-235b-a22b-thinking-2507	Qwen	164	Qwen/Qwen3-235B-A22B-Thinking-2507	79.1
Qwen3-235B-A22B-Thinking-2507-GGUF	medium	IFEval	qwen3-235b-a22b-thinking-2507	unsloth	165	Qwen/Qwen3-235B-A22B-Thinking-2507	79.1
Falcon3-10B-Instruct	medium	IFEval (0-Shot)	falcon3-10b-base	tiiuae	166	tiiuae/Falcon3-10B-Base	78.17
Ling-lite-1.5	medium	IFEval(Prompt Strict)	ling-lite-1-5	inclusionAI	167	inclusionAI/Ling-lite-1.5	77.7
LFM2-8B-A1B-GGUF	low	Unknown	lfm2-8b-a1b	unsloth	168	LiquidAI/LFM2-8B-A1B	77.58
LFM2-8B-A1B	low	Unknown	lfm2-8b-a1b	unsloth	169	LiquidAI/LFM2-8B-A1B	77.58
Qwen2-72B-Instruct	medium	IFEval (Prompt Strict-Acc.)	qwen2-72b	Qwen	170	Qwen/Qwen2-72B	77.3
Nemotron-H-4B-Instruct-128K	low	Unknown	nemotron-h-4b-base-8k	nvidia	171	nvidia/Nemotron-H-4B-Base-8K	76.24
LLaDA2.0-mini-preview	medium	IFEval-strict -prompt	llada2-0-mini-preview	inclusionAI	172	inclusionAI/LLaDA2.0-mini-preview	76.16
Ring-lite-distill-preview	high	Unknown	ling-lite	inclusionAI	173	inclusionAI/Ling-lite	75.3
LFM2-1.2B-GGUF	high	Unknown	lfm2-1-2b	unsloth	174	LiquidAI/LFM2-1.2B	74.89
LFM2-1.2B-unsloth-bnb-4bit	high	Unknown	lfm2-1-2b	unsloth	175	LiquidAI/LFM2-1.2B	74.89
LFM2-1.2B	high	Unknown	lfm2-1-2b	unsloth	176	LiquidAI/LFM2-1.2B	74.89
Qwen3-4B-Instruct-2507	medium	IFEval	qwen3-4b-instruct-2507	Qwen	177	Qwen/Qwen3-4B-Instruct-2507	74.5
Qwen3-4B-Instruct-2507-FP8	medium	IFEval	qwen3-4b-instruct-2507	Qwen	178	Qwen/Qwen3-4B-Instruct-2507	74.5
Qwen3-4B-Instruct-2507-GGUF	medium	IFEval	qwen3-4b-instruct-2507	unsloth	179	Qwen/Qwen3-4B-Instruct-2507	74.5
Qwen3-4B-Instruct-2507-unsloth-bnb-4bit	medium	IFEval	qwen3-4b-instruct-2507	unsloth	180	Qwen/Qwen3-4B-Instruct-2507	74.5
Qwen3-4B-Instruct-2507	medium	IFEval	qwen3-4b-instruct-2507	unsloth	181	Qwen/Qwen3-4B-Instruct-2507	74.5
Qwen3-4B-Instruct-2507-bnb-4bit	medium	IFEval	qwen3-4b-instruct-2507	unsloth	182	Qwen/Qwen3-4B-Instruct-2507	74.5
Qwen3-4B-Instruct-2507-GGUF	medium	IFEval	qwen3-4b-instruct-2507	Mungert	183	Qwen/Qwen3-4B-Instruct-2507	74.5
Qwen3-4B-Instruct-2507-FP8	medium	IFEval	qwen3-4b-instruct-2507-fp8	unsloth	184	Qwen/Qwen3-4B-Instruct-2507-FP8	74.5
Meta-Llama-3.1-8B-Instruct-abliterated	medium	IFEval (0-Shot)	meta-llama-3-1-8b-instruct	mlabonne	185	meta-llama/Meta-Llama-3.1-8B-Instruct	73.29
Llama-3.1-Tulu-3-8B-SFT	medium	IFEval (prompt loose)	llama-3-1-8b	allenai	186	meta-llama/Llama-3.1-8B	72.8
Llama-3.1-Tulu-3-8B	medium	IFEval (prompt loose)	llama-3-1-tulu-3-8b-dpo	allenai	187	allenai/Llama-3.1-Tulu-3-8B-DPO	72.8
Llama-3.1-Tulu-3-8B-DPO	medium	IFEval (prompt loose)	llama-3-1-tulu-3-8b-sft	allenai	188	allenai/Llama-3.1-Tulu-3-8B-SFT	72.8
Llama-3.1-Tulu-3-8B-RM	medium	IFEval (prompt loose)	llama-3-1-tulu-3-8b-sft	allenai	189	allenai/Llama-3.1-Tulu-3-8B-SFT	72.8
Llama-3.1-Tulu-3.1-8B	medium	IFEval (prompt loose)	llama-3-1-tulu-3-8b-dpo	allenai	190	allenai/Llama-3.1-Tulu-3-8B-DPO	72.8
Llama-3.1-Tulu-3-70B	medium	IFEval (prompt loose)	llama-3-1-tulu-3-70b-dpo	allenai	191	allenai/Llama-3.1-Tulu-3-70B-DPO	72.8
Llama-3.1-Tulu-3-70B-SFT	medium	IFEval (prompt loose)	llama-3-1-70b	allenai	192	meta-llama/Llama-3.1-70B	72.8
Llama-3.1-Tulu-3-405B	medium	IFEval (prompt loose)	Unknown	allenai	193	allenai/Llama-3.1-Tulu-3-405B-DPO	72.8
Llama-3.1-Tulu-3-70B-DPO	medium	IFEval (prompt loose)	llama-3-1-tulu-3-70b-sft	allenai	194	allenai/Llama-3.1-Tulu-3-70B-SFT	72.8
Llama-3.1-Tulu-3-8B-GGUF	medium	IFEval (prompt loose)	llama-3-1-tulu-3-8b	unsloth	195	allenai/Llama-3.1-Tulu-3-8B	72.8
Llama-3.1-Tulu-3-405B-SFT	medium	IFEval (prompt loose)	llama-3-1-405b	allenai	196	meta-llama/Llama-3.1-405B	72.8
Llama-3.1-Tulu-3-70B-GGUF	medium	IFEval (prompt loose)	llama-3-1-tulu-3-70b	unsloth	197	allenai/Llama-3.1-Tulu-3-70B	72.8
Llama-3.1-Tulu-3-405B-DPO	medium	IFEval (prompt loose)	Unknown	allenai	198	allenai/Llama-3.1-Tulu-3-405B-SFT	72.8
Nemotron-Research-GooseReason-4B-Instruct	low	Unknown	qwen3-4b-instruct-2507	nvidia	199	Qwen/Qwen3-4B-Instruct-2507	72.36
LFM2-700M	high	Unknown	lfm2-700m	unsloth	200	LiquidAI/LFM2-700M	72.23
LFM2-700M-GGUF	high	Unknown	lfm2-700m	unsloth	201	LiquidAI/LFM2-700M	72.23
Falcon-H1-0.5B-Instruct	medium	IFEval	falcon-h1-0-5b-base	tiiuae	202	tiiuae/Falcon-H1-0.5B-Base	72.07
Falcon-H1-0.5B-Instruct-GGUF	medium	IFEval	falcon-h1-0-5b-base	tiiuae	203	tiiuae/Falcon-H1-0.5B-Base	72.07
Falcon-H1-0.5B-Instruct-GGUF	medium	IFEval	falcon-h1-0-5b-instruct	unsloth	204	tiiuae/Falcon-H1-0.5B-Instruct	72.07
Nemotron-H-8B-Reasoning-128K	medium	IFEVAL-Prompt	nemotron-h-8b-reasoning-128k	nvidia	205	nvidia/Nemotron-H-8B-Reasoning-128K	71.8
Nemotron-H-8B-Reasoning-128K-FP8	medium	IFEVAL-Prompt	nemotron-h-8b-reasoning-128k	nvidia	206	nvidia/Nemotron-H-8B-Reasoning-128K	71.8
LFM2.5-230M	low	Unknown	lfm2-5-230m	unsloth	207	LiquidAI/LFM2.5-230M	71.71
LFM2.5-230M-GGUF	low	Unknown	lfm2-5-230m	unsloth	208	LiquidAI/LFM2.5-230M	71.71
Hermes-3-Llama-3.1-70B-lorablated	medium	IFEval (0-Shot)	hermes-3-llama-3-1-70b	mlabonne	209	NousResearch/Hermes-3-Llama-3.1-70B	71.44
OLMo-2-1124-7B-Instruct	low	Unknown	Unknown	allenai	210	allenai/OLMo-2-1124-7B-DPO	69.9
OLMo-2-1124-13B-Instruct	low	Unknown	olmo-2-1124-13b-instruct-rlvr2	allenai	211	allenai/OLMo-2-1124-13B-Instruct-RLVR2	69.9
OLMo-2-1124-7B-SFT	low	Unknown	olmo2-7b-1124	allenai	212	allenai/OLMo2-7B-1124	69.9
OLMo-2-1124-7B-DPO	low	Unknown	Unknown	allenai	213	allenai/OLMo-2-1124-7B-SFT	69.9
OLMo-2-1124-13B-SFT	low	Unknown	olmo2-13b-1124	allenai	214	allenai/OLMo2-13B-1124	69.9
OLMo-2-1124-13B-DPO	low	Unknown	Unknown	allenai	215	allenai/OLMo-2-1124-13B-SFT	69.9
OLMo-2-1124-7B-Instruct-preview	low	Unknown	Unknown	allenai	216	allenai/OLMo-2-1124-7B-DPO	69.9
OLMo-2-1124-7B-RM	low	Unknown	Unknown	allenai	217	allenai/OLMo-2-1124-7B-SFT	69.9
OLMo-2-1124-7B-RM-Preview	low	Unknown	Unknown	allenai	218	allenai/OLMo-2-1124-7B-SFT	69.9
OLMo-2-1124-13B-RM	low	Unknown	Unknown	allenai	219	allenai/OLMo-2-1124-13B-SFT	69.9
OLMo-2-1124-13B-Instruct-preview	low	Unknown	olmo-2-1124-13b-dpo	allenai	220	allenai/OLMo-2-1124-13B-DPO	69.9
OLMo-2-1124-7B-SFT-Preview	low	Unknown	olmo2-7b-1124	allenai	221	allenai/OLMo2-7B-1124	69.9
OLMo-2-1124-7B-DPO-Preview	low	Unknown	Unknown	allenai	222	allenai/OLMo-2-1124-7B-SFT	69.9
Mellum2-12B-A2.5B-Instruct-GGUF	medium	IFEval	mellum2-12b-a2-5b-instruct	Mungert	223	JetBrains/Mellum2-12B-A2.5B-Instruct	69.3
Mellum2-12B-A2.5B-Thinking-GGUF	medium	IFEval	mellum2-12b-a2-5b-thinking	Mungert	224	JetBrains/Mellum2-12B-A2.5B-Thinking	69.1
glm-4-9b-chat	high	Unknown	glm-4-9b-chat	zai-org	225	zai-org/glm-4-9b-chat	69
glm-4-9b-chat-hf	high	Unknown	glm-4-9b-chat	zai-org	226	THUDM/glm-4-9b-chat	69
OLMo-2-0325-32B-Instruct	low	Unknown	Unknown	allenai	227	allenai/OLMo-2-0325-32B-DPO	66.9
OLMo-2-0325-32B-Instruct-GGUF	low	Unknown	olmo-2-0325-32b-instruct	unsloth	228	allenai/OLMo-2-0325-32B-Instruct	66.9
OLMo-2-0325-32B-SFT	low	Unknown	olmo-2-0325-32b	allenai	229	allenai/OLMo-2-0325-32B	66.9
OLMo-2-0325-32B-DPO	low	Unknown	Unknown	allenai	230	allenai/OLMo-2-0325-32B-SFT	66.9
OLMo-2-0325-32B-Instruct	low	Unknown	olmo-2-0325-32b-instruct	unsloth	231	allenai/OLMo-2-0325-32B-Instruct	66.9
OLMoE-1B-7B-0125-Instruct	medium	IFEval	olmoe-1b-7b-0125-dpo	allenai	232	allenai/OLMoE-1B-7B-0125-DPO	66.36
OLMoE-1B-7B-0125-DPO	medium	IFEval	Unknown	allenai	233	allenai/OLMoE-1B-7B-0125-SFT	66.36
OLMoE-1B-7B-0125-SFT	medium	IFEval	olmoe-1b-7b-0125	allenai	234	allenai/OLMoE-1B-7B-0125	66.36
LFM2-350M	high	Unknown	lfm2-350m	unsloth	235	LiquidAI/LFM2-350M	65.12
LFM2-350M-GGUF	high	Unknown	lfm2-350m	unsloth	236	LiquidAI/LFM2-350M	65.12
LFM2-350M-unsloth-bnb-4bit	high	Unknown	lfm2-350m	unsloth	237	LiquidAI/LFM2-350M	65.12
DeepSeek-V2-Chat-0628	medium	IFEval	deepseek-v2-chat-0628	deepseek-ai	238	deepseek-ai/DeepSeek-V2-Chat-0628	63.8
Llama-3.1-8B-ArliAI-RPMax-v1.1	medium	IFEval (0-Shot)	llama-3-1-8b-arliai-rpmax-v1-1	ArliAI	239	ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.1	63.59
NVIDIA-Nemotron-Nano-9B-v2-Japanese	medium	M-IFEval	nvidia-nemotron-nano-12b-v2-base	nvidia	240	nvidia/NVIDIA-Nemotron-Nano-9B-v2	63.2
bitnet-b1.58-2B-4T-gguf	medium	IFEval	bitnet-b1-58-2b-4t-bf16	microsoft	241	microsoft/bitnet-b1.58-2B-4T-bf16	62.71
bitnet-b1.58-2B-4T	medium	IFEval	bitnet-b1-58-2b-4t	microsoft	242	microsoft/bitnet-b1.58-2B-4T	62.71
bitnet-b1.58-2B-4T-bf16	medium	IFEval	bitnet-b1-58-2b-4t-bf16	microsoft	243	microsoft/bitnet-b1.58-2B-4T-bf16	62.71
Phi-4-reasoning	medium	IFEval Strict	phi-4	microsoft	244	microsoft/phi-4	62.3
Phi-4-reasoning-plus	medium	IFEval Strict	phi-4	microsoft	245	microsoft/phi-4	62.3
Phi-4-reasoning-plus-GGUF	medium	IFEval Strict	phi-4-reasoning-plus	unsloth	246	microsoft/Phi-4-reasoning-plus	62.3
Phi-4-reasoning-GGUF	medium	IFEval Strict	phi-4-reasoning	unsloth	247	microsoft/Phi-4-reasoning	62.3
phi-4-reasoning	medium	IFEval Strict	phi-4-reasoning	unsloth	248	microsoft/phi-4-reasoning	62.3
phi-4-reasoning-unsloth-bnb-4bit	medium	IFEval Strict	phi-4-reasoning	unsloth	249	microsoft/phi-4-reasoning	62.3
phi-4-reasoning-bnb-4bit	medium	IFEval Strict	phi-4-reasoning	unsloth	250	microsoft/phi-4-reasoning	62.3
Phi-4-reasoning-plus-GGUF	medium	IFEval Strict	phi-4	Mungert	251	microsoft/phi-4	62.3
Phi-4-reasoning-plus	medium	IFEval Strict	phi-4-reasoning-plus	unsloth	252	microsoft/Phi-4-reasoning-plus	62.3
Phi-4-reasoning-GGUF	medium	IFEval Strict	phi-4	Mungert	253	microsoft/phi-4	62.3
MobileLLM-Pro-base	medium	IFEval	mobilellm-pro-base	facebook	254	facebook/MobileLLM-Pro-base	62
MobileLLM-Pro	medium	IFEval	mobilellm-pro-base	facebook	255	facebook/MobileLLM-Pro-base	62
Falcon-E-3B-Instruct	high	Unknown	falcon-e-3b-instruct	tiiuae	256	tiiuae/Falcon-E-3B-Instruct	60.97
Falcon-E-3B-Instruct-GGUF	high	Unknown	falcon-e-3b-base	tiiuae	257	tiiuae/Falcon-E-3B-Base	60.97
Ming-Lite-Omni	high	Unknown	ling-lite	inclusionAI	258	inclusionAI/Ling-lite	58.36
SmolLM2-1.7B-Instruct-GGUF	medium	IFEval (Average prompt/inst)	smollm2-1-7b	Mungert	259	HuggingFaceTB/SmolLM2-1.7B	56.7
Ming-Lite-Omni-1.5	low	Average(Open-ended QA)	ming-lite-omni	inclusionAI	260	inclusionAI/Ming-Lite-Omni	55.6
Mistral-Crab-DPO-GGUF	high	Unknown	Unknown	Mungert	261	THU-KEG/Mistral-Crab-DPO	54.5
Falcon-E-1B-Instruct-GGUF	high	Unknown	falcon-e-1b-base	tiiuae	262	tiiuae/Falcon-E-1B-Base	54.35
Falcon-E-1B-Instruct	high	Unknown	falcon-e-1b-instruct	tiiuae	263	tiiuae/Falcon-E-1B-Instruct	54.35
Mistral-Nemo-12B-ArliAI-RPMax-v1.1	medium	IFEval (0-Shot)	mistral-nemo-12b-arliai-rpmax-v1-1	ArliAI	264	ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1	53.49
WizardLM-2-8x22B	medium	IFEval (0-Shot)	Unknown	alpindale	265	—	52.72
LFM2.5-VL-1.6B-GGUF	low	Unknown	Unknown	unsloth	266	LiquidAI/LFM2.5-VL-1.6B	52.29
Ring-lite	medium	IF-Eval	ling-lite-base-1-5	inclusionAI	267	inclusionAI/Ling-lite-base-1.5	51.6
gemma-3-270m	medium	[IF Eval][ifeval]	gemma-3-270m	google	268	google/gemma-3-270m	51.2
gemma-3-270m-it	medium	[IF Eval][ifeval]	gemma-3-270m	google	269	google/gemma-3-270m	51.2
gemma-3-270m-it-GGUF	medium	[IF Eval][ifeval]	gemma-3-270m-it	unsloth	270	google/gemma-3-270m-it	51.2
gemma-3-270m-it	medium	[IF Eval][ifeval]	gemma-3-270m-it	unsloth	271	google/gemma-3-270m-it	51.2
gemma-3-270m-it-unsloth-bnb-4bit	medium	[IF Eval][ifeval]	gemma-3-270m-it	unsloth	272	google/gemma-3-270m-it	51.2
gemma-3-270m-it-qat-GGUF	medium	[IF Eval][ifeval]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	273	google/gemma-3-270m-it-qat-q4_0-unquantized	51.2
gemma-3-270m	medium	[IF Eval][ifeval]	gemma-3-270m	unsloth	274	google/gemma-3-270m	51.2
gemma-3-270m-unsloth-bnb-4bit	medium	[IF Eval][ifeval]	gemma-3-270m-it	unsloth	275	google/gemma-3-270m-it	51.2
gemma-3-270m-it-qat-q4_0-unquantized	medium	[IF Eval][ifeval]	gemma-3-270m-it	google	276	google/gemma-3-270m-it	51.2
gemma-3-270m-it-bnb-4bit	medium	[IF Eval][ifeval]	gemma-3-270m-it	unsloth	277	google/gemma-3-270m-it	51.2
gemma-3-270m-it-qat	medium	[IF Eval][ifeval]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	278	google/gemma-3-270m-it-qat-q4_0-unquantized	51.2
gemma-3-270m-bnb-4bit	medium	[IF Eval][ifeval]	gemma-3-270m	unsloth	279	google/gemma-3-270m	51.2
gemma-3-270m-qat-q4_0-unquantized	medium	[IF Eval][ifeval]	gemma-3-270m	google	280	google/gemma-3-270m	51.2
gemma-3-270m-it-GGUF	medium	[IF Eval][ifeval]	gemma-3-270m	Mungert	281	google/gemma-3-270m	51.2
gemma-3-270m-it-torchao-FP8	medium	[IF Eval][ifeval]	gemma-3-270m-it	unsloth	282	google/gemma-3-270m-it	51.2
Pixtral-12B-2409	medium	Text IF-Eval	Unknown	mistralai	283	mistralai/Pixtral-12B-Base-2409	50.1
ChimeraLlama-3-8B-v2	medium	IFEval (0-Shot)	meta-llama-3-8b-instruct	mlabonne	284	NousResearch/Meta-Llama-3-8B-Instruct	44.69
ChimeraLlama-3-8B-v3	medium	IFEval (0-Shot)	meta-llama-3-8b-instruct	mlabonne	285	NousResearch/Meta-Llama-3-8B-Instruct	44.08
Nemotron-Research-Reasoning-Qwen-1.5B	low	Unknown	deepseek-r1-distill-qwen-1-5b	nvidia	286	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	44.05
Nemotron-Research-Reasoning-Qwen-1.5B-GGUF	low	Unknown	deepseek-r1-distill-qwen-1-5b	Mungert	287	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	44.05
SmolLM2-360M-Instruct-GGUF	medium	IFEval (Average prompt/inst)	smollm2-360m	Mungert	288	HuggingFaceTB/SmolLM2-360M	41
Pixtral-12B-2409	medium	MM IF-Eval	Unknown	mistralai	289	mistralai/Pixtral-12B-Base-2409	38.9
Falcon-E-3B-Base	high	Unknown	falcon-e-3b-base	tiiuae	290	tiiuae/Falcon-E-3B-Base	36.67
Falcon-E-3B-Base-prequantized	high	Unknown	falcon-e-3b-base-prequantized	tiiuae	291	tiiuae/Falcon-E-3B-Base-prequantized	36.67
Falcon3-10B-Base	medium	IFEval (0-Shot)	falcon3-10b-base	tiiuae	292	tiiuae/Falcon3-10B-Base	36.48
falcon-mamba-7b	low	Unknown	falcon-mamba-7b	tiiuae	293	tiiuae/falcon-mamba-7b	33.36
falcon-mamba-7b	medium	IFEval (0-Shot)	falcon-mamba-7b	tiiuae	294	tiiuae/falcon-mamba-7b	33.36
falcon-mamba-7b-instruct	low	Unknown	falcon-mamba-7b	tiiuae	295	tiiuae/falcon-mamba-7b	33.36
falcon-mamba-7b-instruct-Q4_K_M-GGUF	low	Unknown	falcon-mamba-7b-instruct	tiiuae	296	tiiuae/falcon-mamba-7b-instruct	33.36
falcon-mamba-7b-instruct-4bit	low	Unknown	falcon-mamba-7b-instruct	tiiuae	297	tiiuae/falcon-mamba-7b-instruct	33.36
falcon-mamba-7b-Q8_0-GGUF	low	Unknown	falcon-mamba-7b	tiiuae	298	tiiuae/falcon-mamba-7b	33.36
falcon-mamba-7b-Q8_0-GGUF	medium	IFEval (0-Shot)	falcon-mamba-7b	tiiuae	299	tiiuae/falcon-mamba-7b	33.36
falcon-mamba-7b-F16-GGUF	low	Unknown	falcon-mamba-7b	tiiuae	300	tiiuae/falcon-mamba-7b	33.36
falcon-mamba-7b-F16-GGUF	medium	IFEval (0-Shot)	falcon-mamba-7b	tiiuae	301	tiiuae/falcon-mamba-7b	33.36
falcon-mamba-7b-4bit	low	Unknown	falcon-mamba-7b	tiiuae	302	tiiuae/falcon-mamba-7b	33.36
Falcon-E-1B-Base	high	Unknown	falcon-e-1b-base	tiiuae	303	tiiuae/Falcon-E-1B-Base	32.9
SmolLM2-135M-Instruct-GGUF	medium	IFEval (Average prompt/inst)	smollm2-135m	Mungert	304	HuggingFaceTB/SmolLM2-135M	29.9
Youtu-LLM-2B-GGUF	medium	IFEval	youtu-llm-2b-base	Mungert	305	tencent/Youtu-LLM-2B-Base	29.4
LFM2.5-Audio-1.5B	high	Unknown	lfm2-1-2b	LiquidAI	306	LiquidAI/LFM2-1.2B	28.48
LFM2.5-Audio-1.5B-GGUF	high	Unknown	lfm2-1-2b	Mungert	307	LiquidAI/LFM2-1.2B	28.48
OLMo-2-0425-1B-Instruct	low	Unknown	olmo-2-0425-1b-rlvr1	allenai	308	allenai/OLMo-2-0425-1B-RLVR1	25.3
OLMo-2-0425-1B-SFT	low	Unknown	olmo-2-0425-1b	allenai	309	allenai/OLMo-2-0425-1B	25.3
OLMo-2-0425-1B-DPO	low	Unknown	Unknown	allenai	310	allenai/OLMo-2-0425-1B-SFT	25.3
OLMo-2-0425-1B-Instruct-GGUF	low	Unknown	olmo-2-0425-1b-instruct	unsloth	311	allenai/OLMo-2-0425-1B-Instruct	25.3
OLMo-2-0425-1B-Instruct	low	Unknown	olmo-2-0425-1b-instruct	unsloth	312	allenai/OLMo-2-0425-1B-Instruct	25.3
OLMo-2-0425-1B-RLVR1	low	Unknown	Unknown	allenai	313	allenai/OLMo-2-0425-1B-DPO	25.3
Qwen2-1.5B-Instruct	medium	IFEval (Prompt Strict-Acc.)	qwen2-1-5b-instruct	Qwen	314	Qwen/Qwen2-1.5B-Instruct	14.6
Qwen2-0.5B-Instruct	medium	IFEval (Prompt Strict-Acc.)	qwen2-0-5b	Qwen	315	Qwen/Qwen2-0.5B	14.6
llama-3-tulu-2-8b	low	GSM8k 8-shot cot \| BBH 3-shot cot	meta-llama-3-8b	allenai	316	meta-llama/Meta-Llama-3-8B	14.6
llama-3-tulu-2-70b	low	GSM8k 8-shot cot \| BBH 3-shot cot	meta-llama-3-70b	allenai	317	meta-llama/Meta-Llama-3-70B	14.6
LFM2.5-Audio-1.5B-JP	high	Unknown	Unknown	LiquidAI	318	LiquidAI/LFM2.5-Audio-1.5B	14.3

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/if-eval.html
url: huggingface.co/spaces/if-eval ↗