Leaderboard

MMLU-Pro

mmlu-pro

Record

Category: knowledge
Scored models: 465

Scores

Model	Score
cerebras/MiniMax-M2.1-REAP-139B-A10B	88
MiniMaxAI/MiniMax-M2.1	88
MiniMaxAI/MiniMax-M2.1	88
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	86.8
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	86.8
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	86.8
Qwen/Qwen3.6-27B	86.25
Qwen/Qwen3.6-35B-A3B	85.85
Qwen/Qwen3.6-35B-A3B	85.85
google/gemma-4-31B-it	85.25
google/gemma-4-26B-A4B	85.2
google/gemma-4-31B	85.2
google/gemma-4-E4B	85.2
google/gemma-4-E2B	85.2
google/gemma-4-12B	85.2
google/gemma-4-31B-it-qat-q4_0-unquantized	85.2
google/gemma-4-12B-it-qat-q4_0-unquantized	85.2
google/gemma-4-31B-it-assistant	85.2
google/gemma-4-26B-A4B-it	85.2
google/gemma-4-26B-A4B	85.2
google/gemma-4-31B	85.2
google/gemma-4-12B-it	85.2
google/gemma-4-12B-it	85.2
google/gemma-4-31B-it	85.2

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: knowledge
id: mmlu-pro
name: MMLU-Pro
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
MiniMax-M2.1	medium	MMLU-Pro	minimax-m2-1-reap-139b-a10b	MiniMaxAI	1	cerebras/MiniMax-M2.1-REAP-139B-A10B	88
MiniMax-M2.1-GGUF	medium	MMLU-Pro	minimax-m2-1	unsloth	2	MiniMaxAI/MiniMax-M2.1	88
MiniMax-M2.1	medium	MMLU-Pro	minimax-m2-1	unsloth	3	MiniMaxAI/MiniMax-M2.1	88
NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	medium	MMLU-Pro	nvidia-nemotron-3-ultra-550b-a55b-bf16	nvidia	4	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	86.8
NVIDIA-Nemotron-3-Ultra-550B-A55B-GGUF	medium	MMLU-Pro	nvidia-nemotron-3-ultra-550b-a55b-bf16	unsloth	5	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	86.8
NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4	medium	MMLU-Pro	nvidia-nemotron-3-ultra-550b-a55b-bf16	unsloth	6	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	86.8
Qwen3.6-27B-NVFP4	low	Unknown	qwen3-6-27b	unsloth	7	Qwen/Qwen3.6-27B	86.25
Qwen3.6-35B-A3B-NVFP4	low	Unknown	qwen3-6-35b-a3b	unsloth	8	Qwen/Qwen3.6-35B-A3B	85.85
Qwen3.6-35B-A3B-NVFP4-Fast	low	Unknown	qwen3-6-35b-a3b	unsloth	9	Qwen/Qwen3.6-35B-A3B	85.85
Gemma-4-31B-IT-NVFP4	medium	MMLU Pro	gemma-4-31b-it	nvidia	10	google/gemma-4-31B-it	85.25
gemma-4-26B-A4B-it	medium	MMLU Pro	gemma-4-26b-a4b	google	11	google/gemma-4-26B-A4B	85.2
gemma-4-31B-it	medium	MMLU Pro	gemma-4-31b	google	12	google/gemma-4-31B	85.2
gemma-4-E4B-it	medium	MMLU Pro	gemma-4-e4b	google	13	google/gemma-4-E4B	85.2
gemma-4-E2B-it	medium	MMLU Pro	gemma-4-e2b	google	14	google/gemma-4-E2B	85.2
gemma-4-12B-it	medium	MMLU Pro	gemma-4-12b	google	15	google/gemma-4-12B	85.2
gemma-4-31B-it-qat-w4a16-ct	medium	MMLU Pro	gemma-4-31b-it-qat-q4-0-unquantized	google	16	google/gemma-4-31B-it-qat-q4_0-unquantized	85.2
gemma-4-12B-it-qat-w4a16-ct	medium	MMLU Pro	gemma-4-12b-it-qat-q4-0-unquantized	google	17	google/gemma-4-12B-it-qat-q4_0-unquantized	85.2
gemma-4-31B-it-assistant	medium	MMLU Pro	gemma-4-31b-it-assistant	google	18	google/gemma-4-31B-it-assistant	85.2
gemma-4-26B-A4B-it-GGUF	medium	MMLU Pro	gemma-4-26b-a4b-it	unsloth	19	google/gemma-4-26B-A4B-it	85.2
gemma-4-26B-A4B	medium	MMLU Pro	gemma-4-26b-a4b	google	20	google/gemma-4-26B-A4B	85.2
gemma-4-31B	medium	MMLU Pro	gemma-4-31b	google	21	google/gemma-4-31B	85.2
gemma-4-12b-it-GGUF	medium	MMLU Pro	gemma-4-12b-it	unsloth	22	google/gemma-4-12B-it	85.2
gemma-4-12B-it-qat-q4_0-unquantized	medium	MMLU Pro	gemma-4-12b-it	google	23	google/gemma-4-12B-it	85.2
gemma-4-31B-it-GGUF	medium	MMLU Pro	gemma-4-31b-it	unsloth	24	google/gemma-4-31B-it	85.2
gemma-4-E4B-it-GGUF	medium	MMLU Pro	gemma-4-e4b-it	unsloth	25	google/gemma-4-E4B-it	85.2
gemma-4-E2B-it-qat-w4a16-ct	medium	MMLU Pro	gemma-4-e2b-it-qat-q4-0-unquantized	google	26	google/gemma-4-E2B-it-qat-q4_0-unquantized	85.2
gemma-4-26B-A4B-it-qat-GGUF	medium	MMLU Pro	gemma-4-26b-a4b-it-qat-q4-0-unquantized	unsloth	27	google/gemma-4-26B-A4B-it-qat-q4_0-unquantized	85.2
gemma-4-E4B-it-unsloth-bnb-4bit	medium	MMLU Pro	gemma-4-e4b-it	unsloth	28	google/gemma-4-E4B-it	85.2
gemma-4-E2B-it-GGUF	medium	MMLU Pro	gemma-4-e2b	unsloth	29	google/gemma-4-E2B-it	85.2
gemma-4-E4B-it-qat-w4a16-ct	medium	MMLU Pro	gemma-4-e4b-it-qat-q4-0-unquantized	google	30	google/gemma-4-E4B-it-qat-q4_0-unquantized	85.2
gemma-4-31B-it-unsloth-bnb-4bit	medium	MMLU Pro	gemma-4-31b-it	unsloth	31	google/gemma-4-31B-it	85.2
gemma-4-31B-it-qat-GGUF	medium	MMLU Pro	gemma-4-31b-it-qat-q4-0-unquantized	unsloth	32	google/gemma-4-31B-it-qat-q4_0-unquantized	85.2
gemma-4-12B	medium	MMLU Pro	gemma-4-12b	google	33	google/gemma-4-12B	85.2
gemma-4-E4B-it-qat-GGUF	medium	MMLU Pro	gemma-4-e4b-it-qat-q4-0-unquantized	unsloth	34	google/gemma-4-E4B-it-qat-q4_0-unquantized	85.2
gemma-4-26B-A4B-it-assistant	medium	MMLU Pro	gemma-4-26b-a4b-it-assistant	google	35	google/gemma-4-26B-A4B-it-assistant	85.2
gemma-4-12B-it-qat-GGUF	medium	MMLU Pro	gemma-4-12b-it-qat-q4-0-unquantized	unsloth	36	google/gemma-4-12B-it-qat-q4_0-unquantized	85.2
gemma-4-12B-it-qat-q4_0-gguf	medium	MMLU Pro	gemma-4-12b-it-qat-q4-0-unquantized	google	37	google/gemma-4-12B-it-qat-q4_0-unquantized	85.2
gemma-4-E4B	medium	MMLU Pro	gemma-4-e4b	google	38	google/gemma-4-E4B	85.2
gemma-4-E4B-it-qat-q4_0-gguf	medium	MMLU Pro	gemma-4-e4b-it-qat-q4-0-unquantized	google	39	google/gemma-4-E4B-it-qat-q4_0-unquantized	85.2
gemma-4-E2B-it-qat-q4_0-gguf	medium	MMLU Pro	gemma-4-e2b-it-qat-q4-0-unquantized	google	40	google/gemma-4-E2B-it-qat-q4_0-unquantized	85.2
gemma-4-12B-it-assistant	medium	MMLU Pro	gemma-4-12b-it-assistant	google	41	google/gemma-4-12B-it-assistant	85.2
gemma-4-E4B-it	medium	MMLU Pro	gemma-4-e4b-it	unsloth	42	google/gemma-4-E4B-it	85.2
gemma-4-12b-it	medium	MMLU Pro	gemma-4-12b-it	unsloth	43	google/gemma-4-12B-it	85.2
gemma-4-E2B-it-qat-GGUF	medium	MMLU Pro	gemma-4-e2b-it-qat-q4-0-unquantized	unsloth	44	google/gemma-4-E2B-it-qat-q4_0-unquantized	85.2
gemma-4-12B-it-qat-q4_0-unquantized-assistant	medium	MMLU Pro	gemma-4-12b-it-assistant	google	45	google/gemma-4-12B-it-assistant	85.2
gemma-4-26B-A4B-it-qat-q4_0-gguf	medium	MMLU Pro	gemma-4-26b-a4b-it-qat-q4-0-unquantized	google	46	google/gemma-4-26B-A4B-it-qat-q4_0-unquantized	85.2
gemma-4-E2B	medium	MMLU Pro	gemma-4-e2b	google	47	google/gemma-4-E2B	85.2
gemma-4-26B-A4B-it-NVFP4	medium	MMLU Pro	gemma-4-26b-a4b-it	unsloth	48	google/gemma-4-26B-A4B-it	85.2
gemma-4-E2B-it-unsloth-bnb-4bit	medium	MMLU Pro	gemma-4-e2b	unsloth	49	google/gemma-4-E2B-it	85.2
gemma-4-31B-it-qat-q4_0-gguf	medium	MMLU Pro	gemma-4-31b-it-qat-q4-0-unquantized	google	50	google/gemma-4-31B-it-qat-q4_0-unquantized	85.2
gemma-4-E2B-it	medium	MMLU Pro	gemma-4-e2b	unsloth	51	google/gemma-4-E2B-it	85.2
gemma-4-31B-it-qat-w4a16	medium	MMLU Pro	gemma-4-31b-it-qat-q4-0-unquantized	unsloth	52	google/gemma-4-31B-it-qat-q4_0-unquantized	85.2
gemma-4-E2B-it-assistant	medium	MMLU Pro	gemma-4-e2b-it-assistant	google	53	google/gemma-4-E2B-it-assistant	85.2
gemma-4-E4B-it-assistant	medium	MMLU Pro	gemma-4-e4b-it-assistant	google	54	google/gemma-4-E4B-it-assistant	85.2
gemma-4-26B-A4B-it	medium	MMLU Pro	gemma-4-26b-a4b-it	unsloth	55	google/gemma-4-26B-A4B-it	85.2
gemma-4-E2B-it-qat-mobile-ct	medium	MMLU Pro	gemma-4-e2b-it-qat-mobile-transformers	google	56	google/gemma-4-E2B-it-qat-mobile-transformers	85.2
gemma-4-E2B-it-qat-mobile-GGUF	medium	MMLU Pro	gemma-4-e2b-it-qat-mobile-transformers	unsloth	57	google/gemma-4-E2B-it-qat-mobile-transformers	85.2
gemma-4-26B-A4B-it-qat-q4_0-unquantized	medium	MMLU Pro	gemma-4-26b-a4b-it	google	58	google/gemma-4-26B-A4B-it	85.2
gemma-4-E2B-it-qat-q4_0-unquantized	medium	MMLU Pro	gemma-4-e2b	google	59	google/gemma-4-E2B-it	85.2
gemma-4-E4B-it-qat-mobile-ct	medium	MMLU Pro	gemma-4-e4b-it-qat-mobile-transformers	google	60	google/gemma-4-E4B-it-qat-mobile-transformers	85.2
gemma-4-12b-it-NVFP4	medium	MMLU Pro	gemma-4-12b-it	unsloth	61	google/gemma-4-12B-it	85.2
gemma-4-31B-it	medium	MMLU Pro	gemma-4-31b-it	unsloth	62	google/gemma-4-31B-it	85.2
gemma-4-E4B-it-qat-mobile-GGUF	medium	MMLU Pro	gemma-4-e4b-it-qat-mobile-transformers	unsloth	63	google/gemma-4-E4B-it-qat-mobile-transformers	85.2
gemma-4-31B-it-NVFP4	medium	MMLU Pro	gemma-4-31b-it	unsloth	64	google/gemma-4-31B-it	85.2
gemma-4-12b	medium	MMLU Pro	gemma-4-12b	unsloth	65	google/gemma-4-12B	85.2
gemma-4-E2B-it-qat-mobile-transformers	medium	MMLU Pro	gemma-4-e2b	google	66	google/gemma-4-E2B-it	85.2
gemma-4-E4B-it-qat-mobile-transformers	medium	MMLU Pro	gemma-4-e4b-it	google	67	google/gemma-4-E4B-it	85.2
gemma-4-31B-it-qat-q4_0-unquantized-assistant	medium	MMLU Pro	gemma-4-31b-it-assistant	google	68	google/gemma-4-31B-it-assistant	85.2
gemma-4-E4B-it-qat-q4_0-unquantized	medium	MMLU Pro	gemma-4-e4b-it	google	69	google/gemma-4-E4B-it	85.2
gemma-4-26B-A4B-it-qat-q4_0-unquantized-assistant	medium	MMLU Pro	gemma-4-26b-a4b-it-assistant	google	70	google/gemma-4-26B-A4B-it-assistant	85.2
gemma-4-31B-it-qat-q4_0-unquantized	medium	MMLU Pro	gemma-4-31b-it	google	71	google/gemma-4-31B-it	85.2
gemma-4-E4B-it-NVFP4	medium	MMLU Pro	gemma-4-e4b-it	unsloth	72	google/gemma-4-E4B-it	85.2
gemma-4-E2B-it-qat-q4_0-unquantized-assistant	medium	MMLU Pro	gemma-4-e2b-it-assistant	google	73	google/gemma-4-E2B-it-assistant	85.2
gemma-4-E4B-it-qat-q4_0-unquantized-assistant	medium	MMLU Pro	gemma-4-e4b-it-assistant	google	74	google/gemma-4-E4B-it-assistant	85.2
gemma-4-12B-it-qat-q4_0-unquantized	medium	MMLU Pro	gemma-4-12b-it	unsloth	75	google/gemma-4-12B-it	85.2
gemma-4-E2B	medium	MMLU Pro	gemma-4-e2b	unsloth	76	google/gemma-4-E2B	85.2
gemma-4-E2B-it-qat-q4_0-unquantized	medium	MMLU Pro	gemma-4-e2b	unsloth	77	google/gemma-4-E2B-it	85.2
gemma-4-E2B-it-NVFP4	medium	MMLU Pro	gemma-4-e2b	unsloth	78	google/gemma-4-E2B-it	85.2
gemma-4-12B-it-qat-w4a16	medium	MMLU Pro	gemma-4-12b-it-qat-q4-0-unquantized	unsloth	79	google/gemma-4-12B-it-qat-q4_0-unquantized	85.2
gemma-4-26B-A4B-it-qat-q4_0-unquantized	medium	MMLU Pro	gemma-4-26b-a4b-it	unsloth	80	google/gemma-4-26B-A4B-it	85.2
gemma-4-12B-it-GGUF	medium	MMLU Pro	gemma-4-12b	Mungert	81	google/gemma-4-12B	85.2
gemma-4-E4B-it-qat-w4a16	medium	MMLU Pro	gemma-4-e4b-it-qat-q4-0-unquantized	unsloth	82	google/gemma-4-E4B-it-qat-q4_0-unquantized	85.2
gemma-4-26b-a4b-it-UD-MLX-4bit	medium	MMLU Pro	gemma-4-26b-a4b-it	unsloth	83	google/gemma-4-26B-A4B-it	85.2
gemma-4-26B-A4B	medium	MMLU Pro	gemma-4-26b-a4b	unsloth	84	google/gemma-4-26B-A4B	85.2
gemma-4-31B-it-qat-q4_0-unquantized	medium	MMLU Pro	gemma-4-31b-it	unsloth	85	google/gemma-4-31B-it	85.2
gemma-4-E2B-it-qat-w4a16	medium	MMLU Pro	gemma-4-e2b-it-qat-q4-0-unquantized	unsloth	86	google/gemma-4-E2B-it-qat-q4_0-unquantized	85.2
gemma-4-E4B	medium	MMLU Pro	gemma-4-e4b	unsloth	87	google/gemma-4-E4B	85.2
gemma-4-E4B-it-qat-q4_0-unquantized	medium	MMLU Pro	gemma-4-e4b-it	unsloth	88	google/gemma-4-E4B-it	85.2
gemma-4-31B	medium	MMLU Pro	gemma-4-31b	unsloth	89	google/gemma-4-31B	85.2
gemma-4-E4B-it-UD-MLX-4bit	medium	MMLU Pro	gemma-4-e4b-it	unsloth	90	google/gemma-4-E4B-it	85.2
gemma-4-E2B-it-UD-MLX-4bit	medium	MMLU Pro	gemma-4-e2b	unsloth	91	google/gemma-4-E2B-it	85.2
gemma-4-31b-it-MLX-8bit	medium	MMLU Pro	gemma-4-31b-it	unsloth	92	google/gemma-4-31B-it	85.2
gemma-4-26b-a4b-it-MLX-8bit	medium	MMLU Pro	gemma-4-26b-a4b-it	unsloth	93	google/gemma-4-26B-A4B-it	85.2
gemma-4-31B-it-GGUF	medium	MMLU Pro	gemma-4-31b	Mungert	94	google/gemma-4-31B	85.2
gemma-4-E2B-it-qat-mobile	medium	MMLU Pro	gemma-4-e2b-it-qat-q4-0-unquantized	unsloth	95	google/gemma-4-E2B-it-qat-q4_0-unquantized	85.2
gemma-4-E4B-it-MLX-8bit	medium	MMLU Pro	gemma-4-e4b-it	unsloth	96	google/gemma-4-E4B-it	85.2
gemma-4-31b-it-UD-MLX-4bit	medium	MMLU Pro	gemma-4-31b-it	unsloth	97	google/gemma-4-31B-it	85.2
gemma-4-E4B-it-GGUF	medium	MMLU Pro	gemma-4-e4b	Mungert	98	google/gemma-4-E4B	85.2
gemma-4-E2B-it-GGUF	medium	MMLU Pro	gemma-4-e2b	Mungert	99	google/gemma-4-E2B	85.2
gemma-4-E2B-it-MLX-8bit	medium	MMLU Pro	gemma-4-e2b	unsloth	100	google/gemma-4-E2B-it	85.2
gemma-4-26b-a4b-it-UD-MLX-3bit	medium	MMLU Pro	gemma-4-26b-a4b-it	unsloth	101	google/gemma-4-26B-A4B-it	85.2
gemma-4-E4B-it-qat-mobile	medium	MMLU Pro	gemma-4-e4b-it-qat-q4-0-unquantized	unsloth	102	google/gemma-4-E4B-it-qat-q4_0-unquantized	85.2
gemma-4-31b-it-UD-MLX-3bit	medium	MMLU Pro	gemma-4-31b-it	unsloth	103	google/gemma-4-31B-it	85.2
Gemma-4-26B-A4B-NVFP4	medium	MMLU Pro	gemma-4-26b-a4b-it	nvidia	104	google/gemma-4-26B-A4B-it	85
DeepSeek-V3.2-Exp	medium	MMLU-Pro	deepseek-v3-2-exp-base	deepseek-ai	105	deepseek-ai/DeepSeek-V3.2-Exp-Base	85
Qwen3-235B-A22B-Thinking-2507-FP8	medium	MMLU-Pro	qwen3-235b-a22b-thinking-2507	Qwen	106	Qwen/Qwen3-235B-A22B-Thinking-2507	85
Qwen3-235B-A22B-Thinking-2507	medium	MMLU-Pro	qwen3-235b-a22b-thinking-2507	Qwen	107	Qwen/Qwen3-235B-A22B-Thinking-2507	85
Qwen3-235B-A22B-Thinking-2507-GGUF	medium	MMLU-Pro	qwen3-235b-a22b-thinking-2507	unsloth	108	Qwen/Qwen3-235B-A22B-Thinking-2507	85
MiMo-V2-Flash-GGUF	medium	MMLU-Pro	mimo-v2-flash	unsloth	109	XiaomiMiMo/MiMo-V2-Flash	84.9
DeepSeek-V3.1-Terminus	medium	MMLU-Pro	deepseek-v3-1-base	deepseek-ai	110	deepseek-ai/DeepSeek-V3.1-Base	84.8
DeepSeek-V3.1-Terminus-GGUF	medium	MMLU-Pro	deepseek-v3-1-terminus	unsloth	111	deepseek-ai/DeepSeek-V3.1-Terminus	84.8
Kimi-K2-Thinking	medium	MMLU-Pro	kimi-k2-thinking	moonshotai	112	moonshotai/Kimi-K2-Thinking	84.6
Kimi-K2-Thinking-GGUF	medium	MMLU-Pro	kimi-k2-thinking	unsloth	113	moonshotai/Kimi-K2-Thinking	84.6
Kimi-K2-Thinking	medium	MMLU-Pro	kimi-k2-thinking	unsloth	114	moonshotai/Kimi-K2-Thinking	84.6
GLM-4.7	medium	MMLU-Pro	glm-4-7	zai-org	115	zai-org/GLM-4.7	84.3
GLM-4.7-FP8	medium	MMLU-Pro	glm-4-7	zai-org	116	zai-org/GLM-4.7	84.3
GLM-4.7-GGUF	medium	MMLU-Pro	glm-4-7	unsloth	117	zai-org/GLM-4.7	84.3
NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4	medium	MMLU-Pro	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	118	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	83.73
NVIDIA-Nemotron-3-Super-120B-A12B-BF16	medium	MMLU-Pro	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	119	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	83.73
NVIDIA-Nemotron-3-Super-120B-A12B-FP8	medium	MMLU-Pro	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	120	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	83.73
NVIDIA-Nemotron-3-Super-120B-A12B-GGUF	medium	MMLU-Pro	nvidia-nemotron-3-super-120b-a12b-bf16	unsloth	121	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	83.73
NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4	medium	MMLU-Pro	nvidia-nemotron-3-super-120b-a12b-bf16	unsloth	122	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	83.73
NVIDIA-Nemotron-3-Super-120B-A12B-BF16-GGUF	medium	MMLU-Pro	nvidia-nemotron-3-super-120b-a12b-bf16	Mungert	123	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	83.73
NVIDIA-Nemotron-3-Super-120B-A12B	medium	MMLU-Pro	nvidia-nemotron-3-super-120b-a12b-bf16	unsloth	124	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	83.73
NVIDIA-Nemotron-3-Super-120B-A12B-FP8	medium	MMLU-Pro	nvidia-nemotron-3-super-120b-a12b-bf16	unsloth	125	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	83.73
NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	medium	MMLU-ProX (avg en/de/fr/es/it/ja/zh/hi/pt/ko)	nvidia-nemotron-3-ultra-550b-a55b-bf16	nvidia	126	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	83
NVIDIA-Nemotron-3-Ultra-550B-A55B-GGUF	medium	MMLU-ProX (avg en/de/fr/es/it/ja/zh/hi/pt/ko)	nvidia-nemotron-3-ultra-550b-a55b-bf16	unsloth	127	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	83
NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4	medium	MMLU-ProX (avg en/de/fr/es/it/ja/zh/hi/pt/ko)	nvidia-nemotron-3-ultra-550b-a55b-bf16	unsloth	128	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	83
NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4	medium	MMLU-Pro	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	129	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	82.4
NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-FP8	medium	MMLU-Pro	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	130	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	82.4
NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16	medium	MMLU-Pro	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	131	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	82.4
Mistral-Medium-3.5-128B-NVFP4	high	Unknown	mistral-medium-3-5-128b	nvidia	132	mistralai/Mistral-Medium-3.5-128B	82.2
MiniMax-M2	medium	MMLU-Pro	minimax-m2	MiniMaxAI	133	MiniMaxAI/MiniMax-M2	82
MiniMax-M2-GGUF	medium	MMLU-Pro	minimax-m2	unsloth	134	MiniMaxAI/MiniMax-M2	82
Qwen3-30B-A3B-Thinking-2507	medium	MMLU-Pro	qwen3-30b-a3b-thinking-2507	Qwen	135	Qwen/Qwen3-30B-A3B-Thinking-2507	81.9
Qwen3-30B-A3B-Thinking-2507-FP8	medium	MMLU-Pro	qwen3-30b-a3b-thinking-2507	Qwen	136	Qwen/Qwen3-30B-A3B-Thinking-2507	81.9
Qwen3-30B-A3B-Thinking-2507-GGUF	medium	MMLU-Pro	qwen3-30b-a3b-thinking-2507	unsloth	137	Qwen/Qwen3-30B-A3B-Thinking-2507	81.9
Qwen3-30B-A3B-Thinking-2507-GGUF	medium	MMLU-Pro	qwen3-30b-a3b-thinking-2507	Mungert	138	Qwen/Qwen3-30B-A3B-Thinking-2507	81.9
Qwen3-30B-A3B-Thinking-2507	medium	MMLU-Pro	qwen3-30b-a3b-thinking-2507	unsloth	139	Qwen/Qwen3-30B-A3B-Thinking-2507	81.9
MiniMax-M2.7-NVFP4	high	Unknown	minimax-m2-7	nvidia	140	MiniMaxAI/MiniMax-M2.7	81.7
Qwen3-30B-A3B-Instruct-2507	medium	MMLU-Pro	qwen3-30b-a3b-instruct-2507	Qwen	141	Qwen/Qwen3-30B-A3B-Instruct-2507	81.2
Qwen3-30B-A3B-Instruct-2507-FP8	medium	MMLU-Pro	qwen3-30b-a3b-instruct-2507	Qwen	142	Qwen/Qwen3-30B-A3B-Instruct-2507	81.2
Qwen3-30B-A3B-Instruct-2507-GGUF	medium	MMLU-Pro	qwen3-30b-a3b-instruct-2507	unsloth	143	Qwen/Qwen3-30B-A3B-Instruct-2507	81.2
Qwen3-235B-A22B-Instruct-2507-FP8	medium	MMLU-Pro	qwen3-235b-a22b-instruct-2507	Qwen	144	Qwen/Qwen3-235B-A22B-Instruct-2507	81.2
Qwen3-235B-A22B-Instruct-2507	medium	MMLU-Pro	qwen3-235b-a22b-instruct-2507	Qwen	145	Qwen/Qwen3-235B-A22B-Instruct-2507	81.2
Qwen3-235B-A22B-Instruct-2507-GGUF	medium	MMLU-Pro	qwen3-235b-a22b-instruct-2507	unsloth	146	Qwen/Qwen3-235B-A22B-Instruct-2507	81.2
Qwen3-30B-A3B-Instruct-2507	medium	MMLU-Pro	qwen3-30b-a3b-instruct-2507	unsloth	147	Qwen/Qwen3-30B-A3B-Instruct-2507	81.2
Qwen3-30B-A3B-Instruct-2507-GGUF	medium	MMLU-Pro	qwen3-30b-a3b-instruct-2507	Mungert	148	Qwen/Qwen3-30B-A3B-Instruct-2507	81.2
Qwen3-235B-A22B-Instruct-2507-FP8	medium	MMLU-Pro	qwen3-235b-a22b-instruct-2507-fp8	unsloth	149	Qwen/Qwen3-235B-A22B-Instruct-2507-FP8	81.2
diffusiongemma-26B-A4B-it-NVFP4	medium	MMLU Pro	diffusiongemma-26b-a4b-it	nvidia	150	google/diffusiongemma-26B-A4B-it	81
Qwen3-Next-80B-A3B-Thinking	medium	MMLU-Pro	qwen3-next-80b-a3b-thinking	Qwen	151	Qwen/Qwen3-Next-80B-A3B-Thinking	80.9
Qwen3-Next-80B-A3B-Thinking-FP8	medium	MMLU-Pro	qwen3-next-80b-a3b-thinking	Qwen	152	Qwen/Qwen3-Next-80B-A3B-Thinking	80.9
Qwen3-Next-80B-A3B-Thinking-GGUF	medium	MMLU-Pro	qwen3-next-80b-a3b-thinking	unsloth	153	Qwen/Qwen3-Next-80B-A3B-Thinking	80.9
Qwen3-Next-80B-A3B-Thinking-GGUF	medium	MMLU-Pro	qwen3-next-80b-a3b-thinking	Qwen	154	Qwen/Qwen3-Next-80B-A3B-Thinking	80.9
Qwen3-Next-80B-A3B-Thinking	medium	MMLU-Pro	qwen3-next-80b-a3b-thinking	unsloth	155	Qwen/Qwen3-Next-80B-A3B-Thinking	80.9
Qwen3-235B-A22B-Thinking-2507-FP8	medium	MMLU-ProX	qwen3-235b-a22b-thinking-2507	Qwen	156	Qwen/Qwen3-235B-A22B-Thinking-2507	80.6
Qwen3-235B-A22B-Thinking-2507	medium	MMLU-ProX	qwen3-235b-a22b-thinking-2507	Qwen	157	Qwen/Qwen3-235B-A22B-Thinking-2507	80.6
Qwen3-235B-A22B-Thinking-2507-GGUF	medium	MMLU-ProX	qwen3-235b-a22b-thinking-2507	unsloth	158	Qwen/Qwen3-235B-A22B-Thinking-2507	80.6
Trinity-Large-Preview-GGUF	medium	MMLU-Pro	Unknown	unsloth	159	arcee-ai/Trinity-Large-Preview	80.5
Qwen3-30B-A3B-Thinking-2507	medium	MMLU-ProX	qwen3-30b-a3b-thinking-2507	Qwen	160	Qwen/Qwen3-30B-A3B-Thinking-2507	80.2
Qwen3-30B-A3B-Thinking-2507-FP8	medium	MMLU-ProX	qwen3-30b-a3b-thinking-2507	Qwen	161	Qwen/Qwen3-30B-A3B-Thinking-2507	80.2
Qwen3-30B-A3B-Thinking-2507-GGUF	medium	MMLU-ProX	qwen3-30b-a3b-thinking-2507	unsloth	162	Qwen/Qwen3-30B-A3B-Thinking-2507	80.2
Qwen3-30B-A3B-Thinking-2507-GGUF	medium	MMLU-ProX	qwen3-30b-a3b-thinking-2507	Mungert	163	Qwen/Qwen3-30B-A3B-Thinking-2507	80.2
Qwen3-30B-A3B-Thinking-2507	medium	MMLU-ProX	qwen3-30b-a3b-thinking-2507	unsloth	164	Qwen/Qwen3-30B-A3B-Thinking-2507	80.2
med42-70B-GGUF	medium	MMLU Professional Medicine	Unknown	TheBloke	165	m42-health/med42-70b	79.8
NVIDIA-Nemotron-3-Super-120B-A12B-BF16	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	166	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.36
NVIDIA-Nemotron-3-Super-120B-A12B-GGUF	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-super-120b-a12b-bf16	unsloth	167	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.36
NVIDIA-Nemotron-3-Super-120B-A12B-BF16-GGUF	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-super-120b-a12b-bf16	Mungert	168	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.36
NVIDIA-Nemotron-3-Super-120B-A12B	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-super-120b-a12b-bf16	unsloth	169	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.36
NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4	medium	MMLU-ProX (avg over languages)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	170	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.35
NVIDIA-Nemotron-3-Super-120B-A12B-FP8	medium	MMLU-ProX (avg over languages)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	171	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.35
NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4	medium	MMLU-ProX (avg over languages)	nvidia-nemotron-3-super-120b-a12b-bf16	unsloth	172	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.35
NVIDIA-Nemotron-3-Super-120B-A12B-FP8	medium	MMLU-ProX (avg over languages)	nvidia-nemotron-3-super-120b-a12b-bf16	unsloth	173	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.35
NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	medium	MMLU-Pro	nvidia-nemotron-3-ultra-550b-a55b-base-bf16	nvidia	174	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	79.07
Qwen3-4B-Thinking-2507	medium	MMLU-Pro	qwen3-4b-thinking-2507	Qwen	175	Qwen/Qwen3-4B-Thinking-2507	78.5
Qwen3-4B-Thinking-2507-FP8	medium	MMLU-Pro	qwen3-4b-thinking-2507	Qwen	176	Qwen/Qwen3-4B-Thinking-2507	78.5
Qwen3-4B-Thinking-2507-unsloth-bnb-4bit	medium	MMLU-Pro	qwen3-4b-thinking-2507	unsloth	177	Qwen/Qwen3-4B-Thinking-2507	78.5
Qwen3-4B-Thinking-2507-GGUF	medium	MMLU-Pro	qwen3-4b-thinking-2507	unsloth	178	Qwen/Qwen3-4B-Thinking-2507	78.5
Qwen3-4B-Thinking-2507	medium	MMLU-Pro	qwen3-4b-thinking-2507	unsloth	179	Qwen/Qwen3-4B-Thinking-2507	78.5
Qwen3-4B-Thinking-2507-bnb-4bit	medium	MMLU-Pro	qwen3-4b-thinking-2507	unsloth	180	Qwen/Qwen3-4B-Thinking-2507	78.5
Qwen3-4B-Thinking-2507-FP8	medium	MMLU-Pro	qwen3-4b-thinking-2507-fp8	unsloth	181	Qwen/Qwen3-4B-Thinking-2507-FP8	78.5
Qwen3-4B-Thinking-2507-GGUF	medium	MMLU-Pro	qwen3-4b-thinking-2507	Mungert	182	Qwen/Qwen3-4B-Thinking-2507	78.5
Qwen3-Next-80B-A3B-Instruct-FP8	medium	MMLU-Pro	qwen3-next-80b-a3b-instruct	Qwen	183	Qwen/Qwen3-Next-80B-A3B-Instruct	78.4
Qwen3-Next-80B-A3B-Instruct	medium	MMLU-Pro	qwen3-next-80b-a3b-instruct	Qwen	184	Qwen/Qwen3-Next-80B-A3B-Instruct	78.4
Qwen3-Next-80B-A3B-Instruct-GGUF	medium	MMLU-Pro	qwen3-next-80b-a3b-instruct	Qwen	185	Qwen/Qwen3-Next-80B-A3B-Instruct	78.4
Qwen3-Next-80B-A3B-Instruct-GGUF	medium	MMLU-Pro	qwen3-next-80b-a3b-instruct	unsloth	186	Qwen/Qwen3-Next-80B-A3B-Instruct	78.4
Qwen3-Next-80B-A3B-Instruct-bnb-4bit	medium	MMLU-Pro	qwen3-next-80b-a3b-instruct	unsloth	187	Qwen/Qwen3-Next-80B-A3B-Instruct	78.4
Qwen3-Next-80B-A3B-Instruct	medium	MMLU-Pro	qwen3-next-80b-a3b-instruct	unsloth	188	Qwen/Qwen3-Next-80B-A3B-Instruct	78.4
NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4	medium	MMLU-Pro	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	189	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	78.3
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	medium	MMLU-Pro	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	190	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	78.3
NVIDIA-Nemotron-3-Nano-30B-A3B-FP8	medium	MMLU-Pro	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	191	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	78.3
Nemotron-3-Nano-30B-A3B-GGUF	medium	MMLU-Pro	nvidia-nemotron-3-nano-30b-a3b-bf16	unsloth	192	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	78.3
NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4	medium	MMLU-Pro	nvidia-nemotron-3-nano-30b-a3b-nvfp4	unsloth	193	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4	78.3
Nemotron-3-Nano-30B-A3B	medium	MMLU-Pro	nvidia-nemotron-3-nano-30b-a3b-bf16	unsloth	194	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	78.3
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF	medium	MMLU-Pro	nvidia-nemotron-3-nano-30b-a3b-bf16	Mungert	195	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	78.3
Nemotron-3-Nano-30B-A3B-FP8	medium	MMLU-Pro	nvidia-nemotron-3-nano-30b-a3b-bf16	unsloth	196	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	78.3
diffusiongemma-26B-A4B-it	medium	MMLU Pro	diffusiongemma-26b-a4b-it	google	197	google/diffusiongemma-26B-A4B-it	77.6
diffusiongemma-26B-A4B-it-GGUF	medium	MMLU Pro	diffusiongemma-26b-a4b-it	unsloth	198	google/diffusiongemma-26B-A4B-it	77.6
diffusiongemma-26B-A4B-it	medium	MMLU Pro	diffusiongemma-26b-a4b-it	unsloth	199	google/diffusiongemma-26B-A4B-it	77.6
Nemotron-Cascade-14B-Thinking	medium	MMLU Pro	nemotron-cascade-14b-thinking	nvidia	200	nvidia/Nemotron-Cascade-14B-Thinking	77.6
NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	201	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	77.5
NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-FP8	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	202	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	77.5
NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	203	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	77.5
LLaDA2.0-flash-preview	medium	MMLU-PRO	llada2-0-flash-preview	inclusionAI	204	inclusionAI/LLaDA2.0-flash-preview	76.84
Qwen3-Next-80B-A3B-Thinking	medium	MMLU-ProX	qwen3-next-80b-a3b-thinking	Qwen	205	Qwen/Qwen3-Next-80B-A3B-Thinking	76.4
Qwen3-Next-80B-A3B-Thinking-FP8	medium	MMLU-ProX	qwen3-next-80b-a3b-thinking	Qwen	206	Qwen/Qwen3-Next-80B-A3B-Thinking	76.4
Qwen3-Next-80B-A3B-Thinking-GGUF	medium	MMLU-ProX	qwen3-next-80b-a3b-thinking	unsloth	207	Qwen/Qwen3-Next-80B-A3B-Thinking	76.4
Qwen3-Next-80B-A3B-Thinking-GGUF	medium	MMLU-ProX	qwen3-next-80b-a3b-thinking	Qwen	208	Qwen/Qwen3-Next-80B-A3B-Thinking	76.4
Qwen3-Next-80B-A3B-Thinking	medium	MMLU-ProX	qwen3-next-80b-a3b-thinking	unsloth	209	Qwen/Qwen3-Next-80B-A3B-Thinking	76.4
DeepSeek-V3-0324	medium	Unknown	deepseek-v3-0324	deepseek-ai	210	deepseek-ai/DeepSeek-V3-0324	75.9
DeepSeek-V3-0324-GGUF	medium	Unknown	deepseek-v3-0324	unsloth	211	deepseek-ai/DeepSeek-V3-0324	75.9
DeepSeek-V3-0324-GGUF-UD	medium	Unknown	deepseek-v3-0324	unsloth	212	deepseek-ai/DeepSeek-V3-0324	75.9
Qwen3-30B-A3B-Instruct-2507	medium	MMLU-ProX	qwen3-30b-a3b-instruct-2507	Qwen	213	Qwen/Qwen3-30B-A3B-Instruct-2507	75.8
Qwen3-30B-A3B-Instruct-2507-FP8	medium	MMLU-ProX	qwen3-30b-a3b-instruct-2507	Qwen	214	Qwen/Qwen3-30B-A3B-Instruct-2507	75.8
Qwen3-30B-A3B-Instruct-2507-GGUF	medium	MMLU-ProX	qwen3-30b-a3b-instruct-2507	unsloth	215	Qwen/Qwen3-30B-A3B-Instruct-2507	75.8
Qwen3-235B-A22B-Instruct-2507-FP8	medium	MMLU-ProX	qwen3-235b-a22b-instruct-2507	Qwen	216	Qwen/Qwen3-235B-A22B-Instruct-2507	75.8
Qwen3-235B-A22B-Instruct-2507	medium	MMLU-ProX	qwen3-235b-a22b-instruct-2507	Qwen	217	Qwen/Qwen3-235B-A22B-Instruct-2507	75.8
Qwen3-235B-A22B-Instruct-2507-GGUF	medium	MMLU-ProX	qwen3-235b-a22b-instruct-2507	unsloth	218	Qwen/Qwen3-235B-A22B-Instruct-2507	75.8
Qwen3-30B-A3B-Instruct-2507	medium	MMLU-ProX	qwen3-30b-a3b-instruct-2507	unsloth	219	Qwen/Qwen3-30B-A3B-Instruct-2507	75.8
Qwen3-30B-A3B-Instruct-2507-GGUF	medium	MMLU-ProX	qwen3-30b-a3b-instruct-2507	Mungert	220	Qwen/Qwen3-30B-A3B-Instruct-2507	75.8
Qwen3-235B-A22B-Instruct-2507-FP8	medium	MMLU-ProX	qwen3-235b-a22b-instruct-2507-fp8	unsloth	221	Qwen/Qwen3-235B-A22B-Instruct-2507-FP8	75.8
NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	medium	MMLU-Pro	nvidia-nemotron-3-super-120b-a12b-base-bf16	nvidia	222	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	75.65
Nemotron-Cascade-8B	medium	MMLU Pro	nemotron-cascade-8b	nvidia	223	nvidia/Nemotron-Cascade-8B	75.1
Nemotron-Cascade-8B-Thinking	medium	MMLU Pro	nemotron-cascade-8b-thinking	nvidia	224	nvidia/Nemotron-Cascade-8B-Thinking	75.1
MiniMax-Text-01-hf	medium	MMLU-Pro<sup>*</sup>	minimax-text-01-hf	MiniMaxAI	225	MiniMaxAI/MiniMax-Text-01-hf	74.4
MiniMax-Text-01	medium	MMLU-Pro<sup>*</sup>	minimax-text-01	MiniMaxAI	226	MiniMaxAI/MiniMax-Text-01	74.4
LLaDA2.0-flash	medium	MMLU-Pro	llada2-0-flash	inclusionAI	227	inclusionAI/LLaDA2.0-flash	74.23
Qwen3-8B-DMS-8x	medium	MMLU-Pro	qwen3-8b-base	nvidia	228	Qwen/Qwen3-8B	74.2
Qwen3-4B-Thinking-2507	medium	MMLU-ProX	qwen3-4b-thinking-2507	Qwen	229	Qwen/Qwen3-4B-Thinking-2507	73.1
Qwen3-4B-Thinking-2507-FP8	medium	MMLU-ProX	qwen3-4b-thinking-2507	Qwen	230	Qwen/Qwen3-4B-Thinking-2507	73.1
Qwen3-4B-Thinking-2507-unsloth-bnb-4bit	medium	MMLU-ProX	qwen3-4b-thinking-2507	unsloth	231	Qwen/Qwen3-4B-Thinking-2507	73.1
Qwen3-4B-Thinking-2507-GGUF	medium	MMLU-ProX	qwen3-4b-thinking-2507	unsloth	232	Qwen/Qwen3-4B-Thinking-2507	73.1
Qwen3-4B-Thinking-2507	medium	MMLU-ProX	qwen3-4b-thinking-2507	unsloth	233	Qwen/Qwen3-4B-Thinking-2507	73.1
Qwen3-4B-Thinking-2507-bnb-4bit	medium	MMLU-ProX	qwen3-4b-thinking-2507	unsloth	234	Qwen/Qwen3-4B-Thinking-2507	73.1
Qwen3-4B-Thinking-2507-FP8	medium	MMLU-ProX	qwen3-4b-thinking-2507-fp8	unsloth	235	Qwen/Qwen3-4B-Thinking-2507-FP8	73.1
Qwen3-4B-Thinking-2507-GGUF	medium	MMLU-ProX	qwen3-4b-thinking-2507	Mungert	236	Qwen/Qwen3-4B-Thinking-2507	73.1
Qwen3-Next-80B-A3B-Instruct-FP8	medium	MMLU-ProX	qwen3-next-80b-a3b-instruct	Qwen	237	Qwen/Qwen3-Next-80B-A3B-Instruct	72
Qwen3-Next-80B-A3B-Instruct	medium	MMLU-ProX	qwen3-next-80b-a3b-instruct	Qwen	238	Qwen/Qwen3-Next-80B-A3B-Instruct	72
Qwen3-Next-80B-A3B-Instruct-GGUF	medium	MMLU-ProX	qwen3-next-80b-a3b-instruct	Qwen	239	Qwen/Qwen3-Next-80B-A3B-Instruct	72
Qwen3-Next-80B-A3B-Instruct-GGUF	medium	MMLU-ProX	qwen3-next-80b-a3b-instruct	unsloth	240	Qwen/Qwen3-Next-80B-A3B-Instruct	72
Qwen3-Next-80B-A3B-Instruct-bnb-4bit	medium	MMLU-ProX	qwen3-next-80b-a3b-instruct	unsloth	241	Qwen/Qwen3-Next-80B-A3B-Instruct	72
Qwen3-Next-80B-A3B-Instruct	medium	MMLU-ProX	qwen3-next-80b-a3b-instruct	unsloth	242	Qwen/Qwen3-Next-80B-A3B-Instruct	72
Phi-4-reasoning	medium	MMLUPro	phi-4	microsoft	243	microsoft/phi-4	71.5
Phi-4-reasoning-plus	medium	MMLUPro	phi-4	microsoft	244	microsoft/phi-4	71.5
Phi-4-reasoning-plus-GGUF	medium	MMLUPro	phi-4-reasoning-plus	unsloth	245	microsoft/Phi-4-reasoning-plus	71.5
Phi-4-reasoning-GGUF	medium	MMLUPro	phi-4-reasoning	unsloth	246	microsoft/Phi-4-reasoning	71.5
phi-4-reasoning	medium	MMLUPro	phi-4-reasoning	unsloth	247	microsoft/phi-4-reasoning	71.5
phi-4-reasoning-unsloth-bnb-4bit	medium	MMLUPro	phi-4-reasoning	unsloth	248	microsoft/phi-4-reasoning	71.5
phi-4-reasoning-bnb-4bit	medium	MMLUPro	phi-4-reasoning	unsloth	249	microsoft/phi-4-reasoning	71.5
Phi-4-reasoning-plus-GGUF	medium	MMLUPro	phi-4	Mungert	250	microsoft/phi-4	71.5
Phi-4-reasoning-plus	medium	MMLUPro	phi-4-reasoning-plus	unsloth	251	microsoft/Phi-4-reasoning-plus	71.5
Phi-4-reasoning-GGUF	medium	MMLUPro	phi-4	Mungert	252	microsoft/phi-4	71.5
Qwen2.5-VL-32B-Instruct	high	Unknown	qwen2-5-vl-32b-instruct	Qwen	253	Qwen/Qwen2.5-VL-32B-Instruct	68.8
Qwen2.5-VL-32B-Instruct-GGUF	high	Unknown	qwen2-5-vl-32b-instruct	unsloth	254	Qwen/Qwen2.5-VL-32B-Instruct	68.8
Qwen2.5-VL-32B-Instruct-bnb-4bit	high	Unknown	qwen2-5-vl-32b-instruct	unsloth	255	Qwen/Qwen2.5-VL-32B-Instruct	68.8
Qwen2.5-VL-32B-Instruct-GGUF	high	Unknown	qwen2-5-vl-32b-instruct	Mungert	256	Qwen/Qwen2.5-VL-32B-Instruct	68.8
Qwen2.5-VL-32B-Instruct-unsloth-bnb-4bit	high	Unknown	qwen2-5-vl-32b-instruct	unsloth	257	Qwen/Qwen2.5-VL-32B-Instruct	68.8
Kimi-VL-A3B-Thinking-2506	medium	MMLU-Pro	kimi-vl-a3b-instruct	moonshotai	258	moonshotai/Kimi-VL-A3B-Instruct	68.5
NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-BF16	medium	MMLU-Pro	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	259	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	68.28
NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-NVFP4	medium	MMLU-Pro	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	260	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	68.28
NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-FP8	medium	MMLU-Pro	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	261	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	68.28
Ling-2.6-1T-base	medium	MMLU-Pro	ling-2-6-1t	inclusionAI	262	inclusionAI/Ling-2.6-1T	67.91
Mistral-Small-3.1-24B-Instruct-2503	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	mistralai	263	mistralai/Mistral-Small-3.1-24B-Base-2503	66.76
Mistral-Small-3.2-24B-Instruct-2506	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	mistralai	264	mistralai/Mistral-Small-3.1-24B-Base-2503	66.76
Mistral-Small-3.2-24B-Instruct-2506-GGUF	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	unsloth	265	mistralai/Mistral-Small-3.2-24B-Instruct-2506	66.76
Mistral-Small-3.2-24B-Instruct-2506-bnb-4bit	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	unsloth	266	mistralai/Mistral-Small-3.2-24B-Instruct-2506	66.76
Mistral-Small-3.2-24B-Instruct-2506	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	unsloth	267	mistralai/Mistral-Small-3.2-24B-Instruct-2506	66.76
Mistral-Small-3.1-24B-Instruct-2503-GGUF	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-instruct-2503	unsloth	268	mistralai/Mistral-Small-3.1-24B-Instruct-2503	66.76
Mistral-Small-3.2-24B-Instruct-2506-unsloth-bnb-4bit	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	unsloth	269	mistralai/Mistral-Small-3.2-24B-Instruct-2506	66.76
Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-instruct-2503	unsloth	270	mistralai/Mistral-Small-3.1-24B-Instruct-2503	66.76
Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-instruct-2503	unsloth	271	mistralai/Mistral-Small-3.1-24B-Instruct-2503	66.76
Mistral-Small-3.1-24B-Instruct-2503	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-instruct-2503	unsloth	272	mistralai/Mistral-Small-3.1-24B-Instruct-2503	66.76
Mistral-Small-3.1-24B-Instruct-2503-GGUF	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	Mungert	273	mistralai/Mistral-Small-3.1-24B-Base-2503	66.76
Mistral-Small-3.2-24B-Instruct-2506-GGUF	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	Mungert	274	mistralai/Mistral-Small-3.1-24B-Base-2503	66.76
Mistral-Small-3.2-24B-Instruct-2506-FP8	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	unsloth	275	mistralai/Mistral-Small-3.2-24B-Instruct-2506	66.76
Mistral-Small-24B-Instruct-2501	medium	mmlu_pro_5shot_cot_instruct	mistral-small-24b-base-2501	mistralai	276	mistralai/Mistral-Small-24B-Base-2501	66.3
Mistral-Small-24B-Instruct-2501-bnb-4bit	medium	mmlu_pro_5shot_cot_instruct	mistral-small-24b-instruct-2501	unsloth	277	mistralai/Mistral-Small-24B-Instruct-2501	66.3
Mistral-Small-24B-Instruct-2501-GGUF	medium	mmlu_pro_5shot_cot_instruct	mistral-small-24b-instruct-2501	unsloth	278	mistralai/Mistral-Small-24B-Instruct-2501	66.3
Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit	medium	mmlu_pro_5shot_cot_instruct	mistral-small-24b-instruct-2501	unsloth	279	mistralai/Mistral-Small-24B-Instruct-2501	66.3
Mistral-Small-24B-Instruct-2501	medium	mmlu_pro_5shot_cot_instruct	mistral-small-24b-instruct-2501	unsloth	280	mistralai/Mistral-Small-24B-Instruct-2501	66.3
Mistral-Small-24B-Base-2501-unsloth-bnb-4bit	medium	mmlu_pro_5shot_cot_instruct	mistral-small-24b-base-2501	unsloth	281	mistralai/Mistral-Small-24B-Base-2501	66.3
DeepSeek-V4-Flash	medium	MMLU-Pro (EM)	deepseek-v4-flash	deepseek-ai	282	deepseek-ai/DeepSeek-V4-Flash	65.5
DeepSeek-V4-Pro	medium	MMLU-Pro (EM)	deepseek-v4-pro	deepseek-ai	283	deepseek-ai/DeepSeek-V4-Pro	65.5
DeepSeek-V4-Flash-DSpark	medium	MMLU-Pro (EM)	Unknown	deepseek-ai	284	—	65.5
DeepSeek-V4-Flash-GGUF	medium	MMLU-Pro (EM)	deepseek-v4-flash	unsloth	285	deepseek-ai/DeepSeek-V4-Flash	65.5
DeepSeek-V4-Flash	medium	MMLU-Pro (EM)	deepseek-v4-flash	unsloth	286	deepseek-ai/DeepSeek-V4-Flash	65.5
DeepSeek-V4-Pro-DSpark	medium	MMLU-Pro (EM)	Unknown	deepseek-ai	287	—	65.5
DeepSeek-V4-Pro	medium	MMLU-Pro (EM)	deepseek-v4-pro	unsloth	288	deepseek-ai/DeepSeek-V4-Pro	65.5
LLaDA2.0-mini	medium	MMLU-Pro	llada2-0-mini	inclusionAI	289	inclusionAI/LLaDA2.0-mini	65.48
GroveMoE-Inst	low	Unknown	grovemoe-inst	inclusionAI	290	inclusionAI/GroveMoE-Inst	64.9
NVIDIA-Nemotron-Nano-9B-v2-Base	medium	MMLU-Pro 5-shot	nvidia-nemotron-nano-9b-v2-base	nvidia	291	nvidia/NVIDIA-Nemotron-Nano-9B-v2-Base	63.98
NVIDIA-Nemotron-Nano-12B-v2-Base	medium	MMLU-Pro 5-shot	nvidia-nemotron-nano-12b-v2-base	nvidia	292	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	63.98
LLaDA2.0-mini-preview	medium	MMLU-PRO	llada2-0-mini-preview	inclusionAI	293	inclusionAI/LLaDA2.0-mini-preview	63.72
Qwen3-4B-Instruct-2507	medium	MMLU-Pro	qwen3-4b-instruct-2507	Qwen	294	Qwen/Qwen3-4B-Instruct-2507	62.8
Qwen3-4B-Instruct-2507-FP8	medium	MMLU-Pro	qwen3-4b-instruct-2507	Qwen	295	Qwen/Qwen3-4B-Instruct-2507	62.8
Qwen3-4B-Instruct-2507-GGUF	medium	MMLU-Pro	qwen3-4b-instruct-2507	unsloth	296	Qwen/Qwen3-4B-Instruct-2507	62.8
Qwen3-4B-Instruct-2507-unsloth-bnb-4bit	medium	MMLU-Pro	qwen3-4b-instruct-2507	unsloth	297	Qwen/Qwen3-4B-Instruct-2507	62.8
Qwen3-4B-Instruct-2507	medium	MMLU-Pro	qwen3-4b-instruct-2507	unsloth	298	Qwen/Qwen3-4B-Instruct-2507	62.8
Qwen3-4B-Instruct-2507-bnb-4bit	medium	MMLU-Pro	qwen3-4b-instruct-2507	unsloth	299	Qwen/Qwen3-4B-Instruct-2507	62.8
Qwen3-4B-Instruct-2507-GGUF	medium	MMLU-Pro	qwen3-4b-instruct-2507	Mungert	300	Qwen/Qwen3-4B-Instruct-2507	62.8
Qwen3-4B-Instruct-2507-FP8	medium	MMLU-Pro	qwen3-4b-instruct-2507-fp8	unsloth	301	Qwen/Qwen3-4B-Instruct-2507-FP8	62.8
Nemotron-Labs-TwoTower-30B-A3B-Base-BF16	medium	MMLU-Pro (5-shot, CoT EM)	nemotron-labs-twotower-30b-a3b-base-bf16	nvidia	302	nvidia/Nemotron-Labs-TwoTower-30B-A3B-Base-BF16	62.59
Nemotron-H-47B-Base-8K	low	MMLU-Pro 5-shot-cot	nemotron-h-56b-base-8k	nvidia	303	nvidia/Nemotron-H-56B-Base-8K	61.8
NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16	medium	MMLU-Pro (5-shot, CoT EM)	nvidia-nemotron-3-nano-30b-a3b-base-bf16	nvidia	304	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16	61.71
Olmo-3-1125-32B	low	Unknown	olmo-3-1125-32b	allenai	305	allenai/Olmo-3-1125-32B	61.1
Ling-2.6-flash-base	medium	MMLU-Pro	ling-2-6-flash	inclusionAI	306	inclusionAI/Ling-2.6-flash	60.73
GigaChat3-10B-A1.8B-GGUF	medium	MMLU_PRO_EN_FIVE_SHOT	Unknown	Mungert	307	ai-sage/GigaChat3-10B-A1.8B-bf16	60.61
Nemotron-H-56B-Base-8K	low	MMLU-Pro 5-shot CoT	nemotron-h-56b-base-8k	nvidia	308	nvidia/Nemotron-H-56B-Base-8K	60.51
Hunyuan-A13B-Instruct-GGUF	medium	MMLU-Pro	hunyuan-a13b-instruct	unsloth	309	tencent/Hunyuan-A13B-Instruct	60.2
Ring-lite	medium	MMLU-Pro	ling-lite-base-1-5	inclusionAI	310	inclusionAI/Ling-lite-base-1.5	60
NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	311	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	59.5
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	312	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	59.5
NVIDIA-Nemotron-3-Nano-30B-A3B-FP8	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	313	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	59.5
Nemotron-3-Nano-30B-A3B-GGUF	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-nano-30b-a3b-bf16	unsloth	314	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	59.5
NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-nano-30b-a3b-nvfp4	unsloth	315	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4	59.5
Nemotron-3-Nano-30B-A3B	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-nano-30b-a3b-bf16	unsloth	316	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	59.5
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-nano-30b-a3b-bf16	Mungert	317	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	59.5
Nemotron-3-Nano-30B-A3B-FP8	medium	MMLU-ProX (avg over langs)	nvidia-nemotron-3-nano-30b-a3b-bf16	unsloth	318	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	59.5
Falcon-H1-34B-Instruct	medium	MMLU-Pro	falcon-h1-34b-base	tiiuae	319	tiiuae/Falcon-H1-34B-Base	58.73
Falcon-H1-34B-Instruct-GGUF	medium	MMLU-Pro	falcon-h1-34b-instruct	tiiuae	320	tiiuae/Falcon-H1-34B-Instruct	58.73
Falcon-H1-34B-Instruct-GGUF	medium	MMLU-Pro	falcon-h1-34b-instruct	unsloth	321	tiiuae/Falcon-H1-34B-Instruct	58.73
Falcon-H1-34B-Instruct-GPTQ-Int4	medium	MMLU-Pro	falcon-h1-34b-instruct	tiiuae	322	tiiuae/Falcon-H1-34B-Instruct	58.73
Falcon-H1-34B-Base	medium	MMLU-Pro	falcon-h1-34b-base	tiiuae	323	tiiuae/Falcon-H1-34B-Base	57.18
Qwen3-4B-Instruct-2507	medium	MMLU-ProX	qwen3-4b-instruct-2507	Qwen	324	Qwen/Qwen3-4B-Instruct-2507	56.2
Qwen3-4B-Instruct-2507-FP8	medium	MMLU-ProX	qwen3-4b-instruct-2507	Qwen	325	Qwen/Qwen3-4B-Instruct-2507	56.2
Qwen3-4B-Instruct-2507-GGUF	medium	MMLU-ProX	qwen3-4b-instruct-2507	unsloth	326	Qwen/Qwen3-4B-Instruct-2507	56.2
Qwen3-4B-Instruct-2507-unsloth-bnb-4bit	medium	MMLU-ProX	qwen3-4b-instruct-2507	unsloth	327	Qwen/Qwen3-4B-Instruct-2507	56.2
Qwen2-72B-Instruct	medium	MMLU-Pro	qwen2-72b	Qwen	328	Qwen/Qwen2-72B	56.2
Qwen3-4B-Instruct-2507	medium	MMLU-ProX	qwen3-4b-instruct-2507	unsloth	329	Qwen/Qwen3-4B-Instruct-2507	56.2
Qwen3-4B-Instruct-2507-bnb-4bit	medium	MMLU-ProX	qwen3-4b-instruct-2507	unsloth	330	Qwen/Qwen3-4B-Instruct-2507	56.2
Qwen3-4B-Instruct-2507-GGUF	medium	MMLU-ProX	qwen3-4b-instruct-2507	Mungert	331	Qwen/Qwen3-4B-Instruct-2507	56.2
Qwen3-4B-Instruct-2507-FP8	medium	MMLU-ProX	qwen3-4b-instruct-2507-fp8	unsloth	332	Qwen/Qwen3-4B-Instruct-2507-FP8	56.2
Mistral-Small-3.1-24B-Instruct-2503	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT)	mistral-small-3-1-24b-base-2503	mistralai	333	mistralai/Mistral-Small-3.1-24B-Base-2503	56.03
Mistral-Small-3.1-24B-Instruct-2503-GGUF	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT)	mistral-small-3-1-24b-instruct-2503	unsloth	334	mistralai/Mistral-Small-3.1-24B-Instruct-2503	56.03
Mistral-Small-3.1-24B-Base-2503	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT)	mistral-small-3-1-24b-base-2503	mistralai	335	mistralai/Mistral-Small-3.1-24B-Base-2503	56.03
Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT)	mistral-small-3-1-24b-instruct-2503	unsloth	336	mistralai/Mistral-Small-3.1-24B-Instruct-2503	56.03
Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT)	mistral-small-3-1-24b-instruct-2503	unsloth	337	mistralai/Mistral-Small-3.1-24B-Instruct-2503	56.03
Mistral-Small-3.1-24B-Instruct-2503	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT)	mistral-small-3-1-24b-instruct-2503	unsloth	338	mistralai/Mistral-Small-3.1-24B-Instruct-2503	56.03
Mistral-Small-3.1-24B-Instruct-2503-GGUF	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT)	mistral-small-3-1-24b-base-2503	Mungert	339	mistralai/Mistral-Small-3.1-24B-Base-2503	56.03
Mistral-Small-24B-Base-2501	medium	[MMLU Pro][mmlu_pro]	mistral-small-24b-base-2501	mistralai	340	mistralai/Mistral-Small-24B-Base-2501	54.37
Phi-4-mini-instruct	medium	MMLU-Pro (0-shot, CoT)	phi-4-mini-instruct	microsoft	341	microsoft/Phi-4-mini-instruct	52.8
Phi-4-mini-instruct-GGUF	medium	MMLU-Pro (0-shot, CoT)	phi-4-mini-instruct	unsloth	342	microsoft/Phi-4-mini-instruct	52.8
Phi-4-mini-instruct-unsloth-bnb-4bit	medium	MMLU-Pro (0-shot, CoT)	phi-4-mini-instruct	unsloth	343	microsoft/Phi-4-mini-instruct	52.8
Phi-4-mini-instruct-bnb-4bit	medium	MMLU-Pro (0-shot, CoT)	phi-4-mini-instruct	unsloth	344	microsoft/Phi-4-mini-instruct	52.8
Phi-4-mini-instruct	medium	MMLU-Pro (0-shot, CoT)	phi-4-mini-instruct	unsloth	345	microsoft/Phi-4-mini-instruct	52.8
Phi-4-mini-instruct-GGUF	medium	MMLU-Pro (0-shot, CoT)	phi-4-mini-instruct	Mungert	346	microsoft/Phi-4-mini-instruct	52.8
Falcon-H1-7B-Instruct	medium	MMLU-Pro	falcon-h1-7b-base	tiiuae	347	tiiuae/Falcon-H1-7B-Base	51.75
Falcon-H1-7B-Instruct-GPTQ-Int4	medium	MMLU-Pro	falcon-h1-7b-instruct	tiiuae	348	tiiuae/Falcon-H1-7B-Instruct	51.75
Falcon-H1-7B-Instruct-GGUF	medium	MMLU-Pro	falcon-h1-7b-instruct	tiiuae	349	tiiuae/Falcon-H1-7B-Instruct	51.75
Falcon-H1-7B-Instruct-GGUF	medium	MMLU-Pro	falcon-h1-7b-instruct	unsloth	350	tiiuae/Falcon-H1-7B-Instruct	51.75
Phi-mini-MoE-instruct	high	Unknown	phi-mini-moe-instruct	microsoft	351	microsoft/Phi-mini-MoE-instruct	49.68
Qwen2-72B	medium	MMLU-Pro	qwen2-72b	Qwen	352	Qwen/Qwen2-72B	49.5
Falcon-H1-7B-Base	medium	MMLU-Pro	falcon-h1-7b-base	tiiuae	353	tiiuae/Falcon-H1-7B-Base	48.38
OpenReasoning-Nemotron-32B	low	Unknown	qwen2-5-32b	nvidia	354	Qwen/Qwen2.5-32B	47.5
OpenReasoning-Nemotron-1.5B	low	Unknown	qwen2-5-1-5b	nvidia	355	Qwen/Qwen2.5-1.5B	47.5
OpenReasoning-Nemotron-14B	low	Unknown	qwen2-5-14b	nvidia	356	Qwen/Qwen2.5-14B	47.5
OpenReasoning-Nemotron-7B	low	Unknown	qwen2-5-7b	nvidia	357	Qwen/Qwen2.5-7B	47.5
OpenReasoning-Nemotron-32B-GGUF	low	Unknown	qwen2-5-32b	unsloth	358	nvidia/OpenReasoning-Nemotron-32B	47.5
OpenReasoning-Nemotron-7B-GGUF	low	Unknown	qwen2-5-7b-instruct	Mungert	359	Qwen/Qwen2.5-7B-Instruct	47.5
OpenReasoning-Nemotron-1.5B-GGUF	low	Unknown	qwen2-5-1-5b-instruct	Mungert	360	Qwen/Qwen2.5-1.5B-Instruct	47.5
OpenReasoning-Nemotron-14B-GGUF	low	Unknown	qwen2-5-14b	Mungert	361	Qwen/Qwen2.5-14B-Instruct	47.5
OpenReasoning-Nemotron-32B-GGUF	low	Unknown	qwen2-5-32b-instruct	Mungert	362	Qwen/Qwen2.5-32B-Instruct	47.5
Qwen2.5-Omni-3B	medium	MMLU-Pro	qwen2-5-omni-3b	Qwen	363	Qwen/Qwen2.5-Omni-3B	47
Qwen2.5-Omni-7B	medium	MMLU-Pro	qwen2-5-omni-7b	Qwen	364	Qwen/Qwen2.5-Omni-7B	47
Qwen2.5-Omni-7B-AWQ	medium	MMLU-Pro	qwen2-5-omni-7b	Qwen	365	Qwen/Qwen2.5-Omni-7B	47
Qwen2.5-Omni-7B-GGUF	medium	MMLU-Pro	qwen2-5-omni-7b	unsloth	366	Qwen/Qwen2.5-Omni-7B	47
Qwen2.5-Omni-3B-GGUF	medium	MMLU-Pro	qwen2-5-omni-3b	unsloth	367	Qwen/Qwen2.5-Omni-3B	47
Qwen2.5-Omni-7B-GPTQ-Int4	medium	MMLU-Pro	qwen2-5-omni-7b	Qwen	368	Qwen/Qwen2.5-Omni-7B	47
Qwen2.5-Omni-3B-GGUF	medium	MMLU-Pro	qwen2-5-omni-3b	Mungert	369	Qwen/Qwen2.5-Omni-3B	47
Qwen2.5-Omni-7B	medium	MMLU-Pro	qwen2-5-omni-7b	unsloth	370	Qwen/Qwen2.5-Omni-7B	47
Qwen2.5-Omni-7B-GGUF	medium	MMLU-Pro	qwen2-5-omni-7b	Mungert	371	Qwen/Qwen2.5-Omni-7B	47
Qwen2.5-Omni-3B	medium	MMLU-Pro	qwen2-5-omni-3b	unsloth	372	Qwen/Qwen2.5-Omni-3B	47
Phi-3.5-MoE-instruct	medium	Multilingual MMLU-Pro	phi-3-5-moe-instruct	microsoft	373	microsoft/Phi-3.5-MoE-instruct	45.3
LFM2.5-1.2B-Instruct-GGUF	low	Unknown	lfm2-5-1-2b-base	unsloth	374	LiquidAI/LFM2.5-1.2B-Instruct	44.35
LFM2.5-1.2B-Instruct	low	Unknown	lfm2-5-1-2b-base	unsloth	375	LiquidAI/LFM2.5-1.2B-Instruct	44.35
LFM2.5-1.2B-Thinking-GGUF	low	Unknown	lfm2-5-1-2b-thinking	unsloth	376	LiquidAI/LFM2.5-1.2B-Thinking	44.35
LFM2.5-1.2B-Instruct-GGUF	low	Unknown	lfm2-5-1-2b-base	Mungert	377	LiquidAI/LFM2.5-1.2B-Base	44.35
LFM2.5-1.2B-Thinking-GGUF	low	Unknown	lfm2-5-1-2b-base	Mungert	378	LiquidAI/LFM2.5-1.2B-Base	44.35
Nemotron-H-8B-Base-8K	low	MMLU-Pro 5-shot CoT	nemotron-h-8b-base-8k	nvidia	379	nvidia/Nemotron-H-8B-Base-8K	44.01
Falcon-H1-3B-Instruct	medium	MMLU-Pro	falcon-h1-3b-base	tiiuae	380	tiiuae/Falcon-H1-3B-Base	43.69
Falcon-H1-3B-Instruct-GGUF	medium	MMLU-Pro	falcon-h1-3b-base	tiiuae	381	tiiuae/Falcon-H1-3B-Base	43.69
Falcon-H1-3B-Instruct-GGUF	medium	MMLU-Pro	falcon-h1-3b-instruct	unsloth	382	tiiuae/Falcon-H1-3B-Instruct	43.69
Qwen2-57B-A14B-Instruct	medium	MMLU-Pro	qwen2-57b-a14b	Qwen	383	Qwen/Qwen2-57B-A14B	43.3
Falcon-H1-1.5B-Deep-Instruct	medium	MMLU-Pro	falcon-h1-1-5b-deep-base	tiiuae	384	tiiuae/Falcon-H1-1.5B-Deep-Base	41.89
Falcon-H1-1.5B-Deep-Instruct-GGUF	medium	MMLU-Pro	falcon-h1-1-5b-deep-instruct	tiiuae	385	tiiuae/Falcon-H1-1.5B-Deep-Instruct	41.89
Falcon-H1-1.5B-Deep-Instruct-GGUF	medium	MMLU-Pro	falcon-h1-1-5b-deep-instruct	unsloth	386	tiiuae/Falcon-H1-1.5B-Deep-Instruct	41.89
Falcon-H1-1.5B-Deep-Instruct	medium	MMLU-Pro	falcon-h1-1-5b-deep-instruct	unsloth	387	tiiuae/Falcon-H1-1.5B-Deep-Instruct	41.89
Falcon-H1-1.5B-Deep-Instruct-GPTQ-Int4	medium	MMLU-Pro	falcon-h1-1-5b-deep-instruct	tiiuae	388	tiiuae/Falcon-H1-1.5B-Deep-Instruct	41.89
Hermes-3-Llama-3.1-70B-lorablated	medium	MMLU-PRO (5-shot)	hermes-3-llama-3-1-70b	mlabonne	389	NousResearch/Hermes-3-Llama-3.1-70B	41.37
Falcon-H1-1.5B-Deep-Base	medium	MMLU-Pro	falcon-h1-1-5b-deep-base	tiiuae	390	tiiuae/Falcon-H1-1.5B-Deep-Base	41.07
Qwen2-7B-Instruct	medium	MMLU-Pro	qwen2-7b	Qwen	391	Qwen/Qwen2-7B	41
Qwen2-57B-A14B	medium	MMLU-Pro	qwen2-57b-a14b	Qwen	392	Qwen/Qwen2-57B-A14B	41
Falcon-H1-3B-Base	medium	MMLU-Pro	falcon-h1-3b-base	tiiuae	393	tiiuae/Falcon-H1-3B-Base	40.58
Llama-3.1-Tulu-3-70B-SFT	medium	MMLU-PRO (5-shot)	llama-3-1-70b	allenai	394	meta-llama/Llama-3.1-70B	40.27
WizardLM-2-8x22B	medium	MMLU-PRO (5-shot)	Unknown	alpindale	395	—	39.96
Olmo-3-1025-7B	low	Unknown	olmo-3-1025-7b	allenai	396	allenai/Olmo-3-1025-7B	38.8
Olmo-Hybrid-7B	low	Unknown	olmo-hybrid-7b	allenai	397	allenai/Olmo-Hybrid-7B	38.8
Olmo-3-1025-7B-GGUF	low	Unknown	olmo-3-1025-7b	Mungert	398	allenai/Olmo-3-1025-7B	38.8
Falcon3-10B-Instruct	medium	MMLU-PRO (5-shot)	falcon3-10b-base	tiiuae	399	tiiuae/Falcon3-10B-Base	38.1
Falcon-H1-1.5B-Instruct	medium	MMLU-Pro	falcon-h1-1-5b-base	tiiuae	400	tiiuae/Falcon-H1-1.5B-Base	37.8
Falcon-H1-1.5B-Instruct-GGUF	medium	MMLU-Pro	falcon-h1-1-5b-instruct	tiiuae	401	tiiuae/Falcon-H1-1.5B-Instruct	37.8
Falcon-H1-1.5B-Instruct-GGUF	medium	MMLU-Pro	falcon-h1-1-5b-instruct	unsloth	402	tiiuae/Falcon-H1-1.5B-Instruct	37.8
Falcon-H1-1.5B-Instruct-GPTQ-Int4	medium	MMLU-Pro	falcon-h1-1-5b-instruct	tiiuae	403	tiiuae/Falcon-H1-1.5B-Instruct	37.8
Falcon-H1-1.5B-Instruct-GPTQ-Int8	medium	MMLU-Pro	falcon-h1-1-5b-instruct	tiiuae	404	tiiuae/Falcon-H1-1.5B-Instruct	37.8
LFM2-8B-A1B-GGUF	low	Unknown	lfm2-8b-a1b	unsloth	405	LiquidAI/LFM2-8B-A1B	37.42
LFM2-8B-A1B	low	Unknown	lfm2-8b-a1b	unsloth	406	LiquidAI/LFM2-8B-A1B	37.42
Youtu-LLM-2B-GGUF	medium	MMLU-Pro	youtu-llm-2b-base	Mungert	407	tencent/Youtu-LLM-2B-Base	36.5
Phi-tiny-MoE-instruct	high	Unknown	phi-tiny-moe-instruct	microsoft	408	microsoft/Phi-tiny-MoE-instruct	36.34
Falcon3-10B-Base	medium	MMLU-PRO (5-shot)	falcon3-10b-base	tiiuae	409	tiiuae/Falcon3-10B-Base	36
Falcon-H1-1.5B-Base	medium	MMLU-Pro	falcon-h1-1-5b-base	tiiuae	410	tiiuae/Falcon-H1-1.5B-Base	35.53
AceInstruct-7B	medium	MMLU Pro	aceinstruct-7b	nvidia	411	nvidia/AceInstruct-7B	32.4
AceInstruct-1.5B	medium	MMLU Pro	aceinstruct-1-5b	nvidia	412	nvidia/AceInstruct-1.5B	32.4
AceInstruct-72B	medium	MMLU Pro	aceinstruct-72b	nvidia	413	nvidia/AceInstruct-72B	32.4
AceInstruct-1.5B-GGUF	medium	MMLU Pro	aceinstruct-1-5b	Mungert	414	nvidia/AceInstruct-1.5B	32.4
Hunyuan-7B-Instruct-GGUF	medium	MMLU-Pro	hunyuan-7b-pretrain	Mungert	415	tencent/Hunyuan-7B-Pretrain	31.15
Falcon-H1-0.5B-Instruct	medium	MMLU-Pro	falcon-h1-0-5b-base	tiiuae	416	tiiuae/Falcon-H1-0.5B-Base	31.03
Falcon-H1-0.5B-Instruct-GGUF	medium	MMLU-Pro	falcon-h1-0-5b-base	tiiuae	417	tiiuae/Falcon-H1-0.5B-Base	31.03
Falcon-H1-0.5B-Instruct-GGUF	medium	MMLU-Pro	falcon-h1-0-5b-instruct	unsloth	418	tiiuae/Falcon-H1-0.5B-Instruct	31.03
Phi-3.5-mini-instruct	medium	Multilingual MMLU-Pro	phi-3-5-mini-instruct	microsoft	419	microsoft/Phi-3.5-mini-instruct	30.9
Qwen2-7B	medium	MMLU-Pro	qwen2-7b	Qwen	420	Qwen/Qwen2-7B	30.9
Phi-3.5-mini-instruct-bnb-4bit	medium	Multilingual MMLU-Pro	phi-3-5-mini-instruct	unsloth	421	microsoft/Phi-3.5-mini-instruct	30.9
Phi-3.5-mini-instruct	medium	Multilingual MMLU-Pro	phi-3-5-mini-instruct	unsloth	422	microsoft/Phi-3.5-mini-instruct	30.9
jina-vlm	low	GSM-8K	qwen3-1-7b-base	jinaai	423	Qwen/Qwen3-1.7B-Base	30.3
Falcon-H1-0.5B-Base	medium	MMLU-Pro	falcon-h1-0-5b-base	tiiuae	424	tiiuae/Falcon-H1-0.5B-Base	30.04
ChimeraLlama-3-8B-v3	medium	MMLU-PRO (5-shot)	meta-llama-3-8b-instruct	mlabonne	425	NousResearch/Meta-Llama-3-8B-Instruct	29.65
ChimeraLlama-3-8B-v2	medium	MMLU-PRO (5-shot)	meta-llama-3-8b-instruct	mlabonne	426	NousResearch/Meta-Llama-3-8B-Instruct	28.54
Llama-3.1-8B-ArliAI-RPMax-v1.1	medium	MMLU-PRO (5-shot)	llama-3-1-8b-arliai-rpmax-v1-1	ArliAI	427	ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.1	28.35
Meta-Llama-3.1-8B-Instruct-abliterated	medium	MMLU-PRO (5-shot)	meta-llama-3-1-8b-instruct	mlabonne	428	meta-llama/Meta-Llama-3.1-8B-Instruct	27.81
Falcon-E-3B-Base	high	Unknown	falcon-e-3b-base	tiiuae	429	tiiuae/Falcon-E-3B-Base	27.16
Falcon-E-3B-Base-prequantized	high	Unknown	falcon-e-3b-base-prequantized	tiiuae	430	tiiuae/Falcon-E-3B-Base-prequantized	27.16
AI21-Jamba-Reasoning-3B-GGUF	low	Unknown	Unknown	Mungert	431	ai21labs/AI21-Jamba-Reasoning-3B	27
Mistral-Nemo-12B-ArliAI-RPMax-v1.1	medium	MMLU-PRO (5-shot)	mistral-nemo-12b-arliai-rpmax-v1-1	ArliAI	432	ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1	26.49
FlexOlmo-7x7B-1T	low	Unknown	flexolmo-7x7b-1t	allenai	433	allenai/FlexOlmo-7x7B-1T	26.2
FlexOlmo-7x7B-1T-RT	low	Unknown	flexolmo-7x7b-1t-rt	allenai	434	allenai/FlexOlmo-7x7B-1T-RT	26.2
Flex-pes2o-2x7B-1T	low	Unknown	flex-pes2o-2x7b-1t	allenai	435	allenai/Flex-pes2o-2x7B-1T	26.2
Flex-creative-2x7B-1T	low	Unknown	flex-creative-2x7b-1t	allenai	436	allenai/Flex-creative-2x7B-1T	26.2
Flex-public-7B-1T	low	Unknown	flex-public-7b-1t	allenai	437	allenai/Flex-public-7B-1T	26.2
Flex-reddit-2x7B-1T	high	Unknown	flex-reddit-2x7b-1t	allenai	438	allenai/Flex-reddit-2x7B-1T	25.5
Flex-math-2x7B-1T	high	Unknown	flex-math-2x7b-1t	allenai	439	allenai/Flex-math-2x7B-1T	24.1
OLMo-2-1124-7B	low	Unknown	olmo-2-1124-7b	allenai	440	allenai/OLMo-2-1124-7B	23.9
OLMo-2-1124-13B	low	Unknown	olmo-2-1124-13b	allenai	441	allenai/OLMo-2-1124-13B	23.9
OLMo-2-0325-32B	low	Unknown	olmo-2-0325-32b	allenai	442	allenai/OLMo-2-0325-32B	23.9
LFM2.5-230M	low	Unknown	lfm2-5-230m	unsloth	443	LiquidAI/LFM2.5-230M	20.25
LFM2.5-230M-GGUF	low	Unknown	lfm2-5-230m	unsloth	444	LiquidAI/LFM2.5-230M	20.25
Llama-3.1-Tulu-3-8B	medium	MMLU-PRO (5-shot)	llama-3-1-tulu-3-8b-dpo	allenai	445	allenai/Llama-3.1-Tulu-3-8B-DPO	20.23
SmolLM2-1.7B-Instruct-GGUF	medium	MMLU-Pro (MCF)	smollm2-1-7b	Mungert	446	HuggingFaceTB/SmolLM2-1.7B	19.4
Falcon-E-1B-Base	high	Unknown	falcon-e-1b-base	tiiuae	447	tiiuae/Falcon-E-1B-Base	17.82
Qwen2-0.5B	medium	MMLU-Pro	qwen2-0-5b	Qwen	448	Qwen/Qwen2-0.5B	15.9
Qwen2-1.5B	medium	MMLU-Pro	qwen2-1-5b	Qwen	449	Qwen/Qwen2-1.5B	15.9
Flex-news-2x7B-1T	high	Unknown	flex-news-2x7b-1t	allenai	450	allenai/Flex-news-2x7B-1T	15.2
Flex-code-2x7B-1T	high	Unknown	flex-code-2x7b-1t	allenai	451	allenai/Flex-code-2x7B-1T	14.5
falcon-mamba-7b	low	Unknown	falcon-mamba-7b	tiiuae	452	tiiuae/falcon-mamba-7b	14.47
falcon-mamba-7b	medium	MMLU-PRO (5-shot)	falcon-mamba-7b	tiiuae	453	tiiuae/falcon-mamba-7b	14.47
falcon-mamba-7b-instruct	low	Unknown	falcon-mamba-7b	tiiuae	454	tiiuae/falcon-mamba-7b	14.47
falcon-mamba-7b-instruct-Q4_K_M-GGUF	low	Unknown	falcon-mamba-7b-instruct	tiiuae	455	tiiuae/falcon-mamba-7b-instruct	14.47
falcon-mamba-7b-instruct-4bit	low	Unknown	falcon-mamba-7b-instruct	tiiuae	456	tiiuae/falcon-mamba-7b-instruct	14.47
falcon-mamba-7b-Q8_0-GGUF	low	Unknown	falcon-mamba-7b	tiiuae	457	tiiuae/falcon-mamba-7b	14.47
falcon-mamba-7b-Q8_0-GGUF	medium	MMLU-PRO (5-shot)	falcon-mamba-7b	tiiuae	458	tiiuae/falcon-mamba-7b	14.47
falcon-mamba-7b-F16-GGUF	low	Unknown	falcon-mamba-7b	tiiuae	459	tiiuae/falcon-mamba-7b	14.47
falcon-mamba-7b-F16-GGUF	medium	MMLU-PRO (5-shot)	falcon-mamba-7b	tiiuae	460	tiiuae/falcon-mamba-7b	14.47
falcon-mamba-7b-4bit	low	Unknown	falcon-mamba-7b	tiiuae	461	tiiuae/falcon-mamba-7b	14.47
Falcon-E-1B-Instruct-GGUF	high	Unknown	falcon-e-1b-base	tiiuae	462	tiiuae/Falcon-E-1B-Base	9.64
Falcon-E-1B-Instruct	high	Unknown	falcon-e-1b-instruct	tiiuae	463	tiiuae/Falcon-E-1B-Instruct	9.64
Falcon-E-3B-Instruct	high	Unknown	falcon-e-3b-instruct	tiiuae	464	tiiuae/Falcon-E-3B-Instruct	7.45
Falcon-E-3B-Instruct-GGUF	high	Unknown	falcon-e-3b-base	tiiuae	465	tiiuae/Falcon-E-3B-Base	7.45

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/mmlu-pro.html
url: huggingface.co/spaces/mmlu ↗