Leaderboard

GPQA

gpqa

Record

Category: reasoning
Scored models: 421

Scores

Model	Score
meta-llama/Meta-Llama-3.1-8B-Instruct	89
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	87
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	87
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	87
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	87
Qwen/Qwen3.6-35B-A3B	86.74
Qwen/Qwen3.6-35B-A3B	86.74
Qwen/Qwen3.6-27B	86.34
MiniMaxAI/MiniMax-M2.5	85.2
MiniMaxAI/MiniMax-M2.5	85.2
moonshotai/Kimi-K2-Thinking	84.5
moonshotai/Kimi-K2-Thinking	84.5
moonshotai/Kimi-K2-Thinking	84.5
cerebras/MiniMax-M2.1-REAP-139B-A10B	83
MiniMaxAI/MiniMax-M2.1	83
MiniMaxAI/MiniMax-M2.1	83
Qwen/Qwen3-30B-A3B-Thinking-2507	82.8
Qwen/Qwen3-30B-A3B-Thinking-2507	82.8
Qwen/Qwen3-30B-A3B-Thinking-2507	82.8
Qwen/Qwen3-30B-A3B-Thinking-2507	82.8
Qwen/Qwen3-30B-A3B-Thinking-2507	82.8
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	82.7
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	82.7
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	82.7

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: reasoning
id: gpqa
name: GPQA
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
Meta-Llama-3.1-8B-Instruct-abliterated	medium	GPQA (0-shot)	meta-llama-3-1-8b-instruct	mlabonne	1	meta-llama/Meta-Llama-3.1-8B-Instruct	89
NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	medium	GPQA (no tools)	nvidia-nemotron-3-ultra-550b-a55b-bf16	nvidia	2	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	87
NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4	medium	GPQA (no tools)	nvidia-nemotron-3-ultra-550b-a55b-bf16	nvidia	3	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	87
NVIDIA-Nemotron-3-Ultra-550B-A55B-GGUF	medium	GPQA (no tools)	nvidia-nemotron-3-ultra-550b-a55b-bf16	unsloth	4	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	87
NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4	medium	GPQA (no tools)	nvidia-nemotron-3-ultra-550b-a55b-bf16	unsloth	5	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16	87
Qwen3.6-35B-A3B-NVFP4	low	Unknown	qwen3-6-35b-a3b	unsloth	6	Qwen/Qwen3.6-35B-A3B	86.74
Qwen3.6-35B-A3B-NVFP4-Fast	low	Unknown	qwen3-6-35b-a3b	unsloth	7	Qwen/Qwen3.6-35B-A3B	86.74
Qwen3.6-27B-NVFP4	low	Unknown	qwen3-6-27b	unsloth	8	Qwen/Qwen3.6-27B	86.34
MiniMax-M2.5	medium	GPQA-D	minimax-m2-5	MiniMaxAI	9	MiniMaxAI/MiniMax-M2.5	85.2
MiniMax-M2.5-GGUF	medium	GPQA-D	minimax-m2-5	unsloth	10	MiniMaxAI/MiniMax-M2.5	85.2
Kimi-K2-Thinking	medium	GPQA	kimi-k2-thinking	moonshotai	11	moonshotai/Kimi-K2-Thinking	84.5
Kimi-K2-Thinking-GGUF	medium	GPQA	kimi-k2-thinking	unsloth	12	moonshotai/Kimi-K2-Thinking	84.5
Kimi-K2-Thinking	medium	GPQA	kimi-k2-thinking	unsloth	13	moonshotai/Kimi-K2-Thinking	84.5
MiniMax-M2.1	medium	GPQA-D	minimax-m2-1-reap-139b-a10b	MiniMaxAI	14	cerebras/MiniMax-M2.1-REAP-139B-A10B	83
MiniMax-M2.1-GGUF	medium	GPQA-D	minimax-m2-1	unsloth	15	MiniMaxAI/MiniMax-M2.1	83
MiniMax-M2.1	medium	GPQA-D	minimax-m2-1	unsloth	16	MiniMaxAI/MiniMax-M2.1	83
Qwen3-30B-A3B-Thinking-2507	medium	GPQA	qwen3-30b-a3b-thinking-2507	Qwen	17	Qwen/Qwen3-30B-A3B-Thinking-2507	82.8
Qwen3-30B-A3B-Thinking-2507-FP8	medium	GPQA	qwen3-30b-a3b-thinking-2507	Qwen	18	Qwen/Qwen3-30B-A3B-Thinking-2507	82.8
Qwen3-30B-A3B-Thinking-2507-GGUF	medium	GPQA	qwen3-30b-a3b-thinking-2507	unsloth	19	Qwen/Qwen3-30B-A3B-Thinking-2507	82.8
Qwen3-30B-A3B-Thinking-2507-GGUF	medium	GPQA	qwen3-30b-a3b-thinking-2507	Mungert	20	Qwen/Qwen3-30B-A3B-Thinking-2507	82.8
Qwen3-30B-A3B-Thinking-2507	medium	GPQA	qwen3-30b-a3b-thinking-2507	unsloth	21	Qwen/Qwen3-30B-A3B-Thinking-2507	82.8
NVIDIA-Nemotron-3-Super-120B-A12B-BF16	medium	GPQA (with tools)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	22	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	82.7
NVIDIA-Nemotron-3-Super-120B-A12B-GGUF	medium	GPQA (with tools)	nvidia-nemotron-3-super-120b-a12b-bf16	unsloth	23	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	82.7
NVIDIA-Nemotron-3-Super-120B-A12B-BF16-GGUF	medium	GPQA (with tools)	nvidia-nemotron-3-super-120b-a12b-bf16	Mungert	24	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	82.7
NVIDIA-Nemotron-3-Super-120B-A12B	medium	GPQA (with tools)	nvidia-nemotron-3-super-120b-a12b-bf16	unsloth	25	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	82.7
Qwen3-235B-A22B-Thinking-2507-FP8	medium	GPQA	qwen3-235b-a22b-thinking-2507	Qwen	26	Qwen/Qwen3-235B-A22B-Thinking-2507	81
Qwen3-235B-A22B-Thinking-2507	medium	GPQA	qwen3-235b-a22b-thinking-2507	Qwen	27	Qwen/Qwen3-235B-A22B-Thinking-2507	81
Qwen3-235B-A22B-Thinking-2507-GGUF	medium	GPQA	qwen3-235b-a22b-thinking-2507	unsloth	28	Qwen/Qwen3-235B-A22B-Thinking-2507	81
NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4	medium	GPQA (with tools)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	29	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.5
NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-FP8	medium	GPQA (with tools)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	30	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.5
NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16	medium	GPQA (with tools)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	31	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.5
NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4	medium	GPQA (no tools)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	32	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.23
NVIDIA-Nemotron-3-Super-120B-A12B-BF16	medium	GPQA (no tools)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	33	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.23
NVIDIA-Nemotron-3-Super-120B-A12B-FP8	medium	GPQA (no tools)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	34	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.23
NVIDIA-Nemotron-3-Super-120B-A12B-GGUF	medium	GPQA (no tools)	nvidia-nemotron-3-super-120b-a12b-bf16	unsloth	35	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.23
NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4	medium	GPQA (no tools)	nvidia-nemotron-3-super-120b-a12b-bf16	unsloth	36	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.23
NVIDIA-Nemotron-3-Super-120B-A12B-BF16-GGUF	medium	GPQA (no tools)	nvidia-nemotron-3-super-120b-a12b-bf16	Mungert	37	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.23
NVIDIA-Nemotron-3-Super-120B-A12B	medium	GPQA (no tools)	nvidia-nemotron-3-super-120b-a12b-bf16	unsloth	38	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.23
NVIDIA-Nemotron-3-Super-120B-A12B-FP8	medium	GPQA (no tools)	nvidia-nemotron-3-super-120b-a12b-bf16	unsloth	39	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	79.23
NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4	medium	GPQA (no tools)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	40	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	78.6
NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-FP8	medium	GPQA (no tools)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	41	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	78.6
NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16	medium	GPQA (no tools)	nvidia-nemotron-3-super-120b-a12b-bf16	nvidia	42	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16	78.6
GLM-4.7-Flash	medium	GPQA	glm-4-7-flash	zai-org	43	zai-org/GLM-4.7-Flash	75.2
GLM-4.7-Flash	medium	GPQA	glm-4-7-flash	unsloth	44	zai-org/GLM-4.7-Flash	75.2
GLM-4.7-Flash-FP8-Dynamic	medium	GPQA	glm-4-7-flash	unsloth	45	zai-org/GLM-4.7-Flash	75.2
GLM-4.7-Flash-GGUF	medium	GPQA	glm-4-7-flash	unsloth	46	zai-org/GLM-4.7-Flash	75.2
GLM-4.7-Flash-NVFP4	medium	GPQA	glm-4-7-flash	unsloth	47	zai-org/GLM-4.7-Flash	75.2
GLM-4.7-Flash-GGUF	medium	GPQA	glm-4-7-flash	Mungert	48	zai-org/GLM-4.7-Flash	75.2
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	medium	GPQA (with tools)	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	49	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	75
NVIDIA-Nemotron-3-Nano-30B-A3B-FP8	medium	GPQA (with tools)	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	50	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	75
Nemotron-3-Nano-30B-A3B-GGUF	medium	GPQA (with tools)	nvidia-nemotron-3-nano-30b-a3b-bf16	unsloth	51	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	75
Nemotron-3-Nano-30B-A3B	medium	GPQA (with tools)	nvidia-nemotron-3-nano-30b-a3b-bf16	unsloth	52	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	75
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF	medium	GPQA (with tools)	nvidia-nemotron-3-nano-30b-a3b-bf16	Mungert	53	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	75
Nemotron-3-Nano-30B-A3B-FP8	medium	GPQA (with tools)	nvidia-nemotron-3-nano-30b-a3b-bf16	unsloth	54	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	75
Qwen3-Next-80B-A3B-Thinking	medium	GPQA	qwen3-next-80b-a3b-thinking	Qwen	55	Qwen/Qwen3-Next-80B-A3B-Thinking	73.4
Qwen3-Next-80B-A3B-Thinking-FP8	medium	GPQA	qwen3-next-80b-a3b-thinking	Qwen	56	Qwen/Qwen3-Next-80B-A3B-Thinking	73.4
Qwen3-Next-80B-A3B-Thinking-GGUF	medium	GPQA	qwen3-next-80b-a3b-thinking	unsloth	57	Qwen/Qwen3-Next-80B-A3B-Thinking	73.4
Qwen3-Next-80B-A3B-Thinking-GGUF	medium	GPQA	qwen3-next-80b-a3b-thinking	Qwen	58	Qwen/Qwen3-Next-80B-A3B-Thinking	73.4
Qwen3-Next-80B-A3B-Thinking	medium	GPQA	qwen3-next-80b-a3b-thinking	unsloth	59	Qwen/Qwen3-Next-80B-A3B-Thinking	73.4
NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4	medium	GPQA (no tools)	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	60	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	73
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	medium	GPQA (no tools)	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	61	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	73
NVIDIA-Nemotron-3-Nano-30B-A3B-FP8	medium	GPQA (no tools)	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	62	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	73
Nemotron-3-Nano-30B-A3B-GGUF	medium	GPQA (no tools)	nvidia-nemotron-3-nano-30b-a3b-bf16	unsloth	63	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	73
NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4	medium	GPQA (no tools)	nvidia-nemotron-3-nano-30b-a3b-nvfp4	unsloth	64	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4	73
Nemotron-3-Nano-30B-A3B	medium	GPQA (no tools)	nvidia-nemotron-3-nano-30b-a3b-bf16	unsloth	65	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	73
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF	medium	GPQA (no tools)	nvidia-nemotron-3-nano-30b-a3b-bf16	Mungert	66	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	73
Nemotron-3-Nano-30B-A3B-FP8	medium	GPQA (no tools)	nvidia-nemotron-3-nano-30b-a3b-bf16	unsloth	67	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	73
Qwen3-235B-A22B-GPTQ-Int4	low	Unknown	Unknown	Qwen	68	Qwen/Qwen3-235B-A22B	71.1
Qwen3-Next-80B-A3B-Instruct-FP8	medium	GPQA	qwen3-next-80b-a3b-instruct	Qwen	69	Qwen/Qwen3-Next-80B-A3B-Instruct	70.4
Qwen3-Next-80B-A3B-Instruct	medium	GPQA	qwen3-next-80b-a3b-instruct	Qwen	70	Qwen/Qwen3-Next-80B-A3B-Instruct	70.4
Qwen3-Next-80B-A3B-Instruct-GGUF	medium	GPQA	qwen3-next-80b-a3b-instruct	Qwen	71	Qwen/Qwen3-Next-80B-A3B-Instruct	70.4
Qwen3-Next-80B-A3B-Instruct-GGUF	medium	GPQA	qwen3-next-80b-a3b-instruct	unsloth	72	Qwen/Qwen3-Next-80B-A3B-Instruct	70.4
Qwen3-Next-80B-A3B-Instruct-bnb-4bit	medium	GPQA	qwen3-next-80b-a3b-instruct	unsloth	73	Qwen/Qwen3-Next-80B-A3B-Instruct	70.4
Qwen3-Next-80B-A3B-Instruct	medium	GPQA	qwen3-next-80b-a3b-instruct	unsloth	74	Qwen/Qwen3-Next-80B-A3B-Instruct	70.4
Qwen3-30B-A3B-Instruct-2507	medium	GPQA	qwen3-30b-a3b-instruct-2507	Qwen	75	Qwen/Qwen3-30B-A3B-Instruct-2507	68.4
Qwen3-32B-AWQ	low	Unknown	qwen3-32b	Qwen	76	Qwen/Qwen3-32B	68.4
Qwen3-30B-A3B-Instruct-2507-FP8	medium	GPQA	qwen3-30b-a3b-instruct-2507	Qwen	77	Qwen/Qwen3-30B-A3B-Instruct-2507	68.4
Qwen3-30B-A3B-Instruct-2507-GGUF	medium	GPQA	qwen3-30b-a3b-instruct-2507	unsloth	78	Qwen/Qwen3-30B-A3B-Instruct-2507	68.4
Qwen3-235B-A22B-Instruct-2507-FP8	medium	GPQA	qwen3-235b-a22b-instruct-2507	Qwen	79	Qwen/Qwen3-235B-A22B-Instruct-2507	68.4
Qwen3-235B-A22B-Instruct-2507	medium	GPQA	qwen3-235b-a22b-instruct-2507	Qwen	80	Qwen/Qwen3-235B-A22B-Instruct-2507	68.4
Qwen3-235B-A22B-Instruct-2507-GGUF	medium	GPQA	qwen3-235b-a22b-instruct-2507	unsloth	81	Qwen/Qwen3-235B-A22B-Instruct-2507	68.4
Qwen3-30B-A3B-Instruct-2507	medium	GPQA	qwen3-30b-a3b-instruct-2507	unsloth	82	Qwen/Qwen3-30B-A3B-Instruct-2507	68.4
Qwen3-30B-A3B-Instruct-2507-GGUF	medium	GPQA	qwen3-30b-a3b-instruct-2507	Mungert	83	Qwen/Qwen3-30B-A3B-Instruct-2507	68.4
Qwen3-235B-A22B-Instruct-2507-FP8	medium	GPQA	qwen3-235b-a22b-instruct-2507-fp8	unsloth	84	Qwen/Qwen3-235B-A22B-Instruct-2507-FP8	68.4
Qwen3-4B-Thinking-2507	medium	GPQA	qwen3-4b-thinking-2507	Qwen	85	Qwen/Qwen3-4B-Thinking-2507	65.8
Qwen3-4B-Thinking-2507-FP8	medium	GPQA	qwen3-4b-thinking-2507	Qwen	86	Qwen/Qwen3-4B-Thinking-2507	65.8
Qwen3-30B-A3B-GPTQ-Int4	low	Unknown	qwen3-30b-a3b-base	Qwen	87	Qwen/Qwen3-30B-A3B	65.8
Phi-4-reasoning	high	Unknown	phi-4	microsoft	88	microsoft/phi-4	65.8
Phi-4-reasoning-plus	high	Unknown	phi-4	microsoft	89	microsoft/phi-4	65.8
Phi-4-reasoning-plus-GGUF	high	Unknown	phi-4-reasoning-plus	unsloth	90	microsoft/Phi-4-reasoning-plus	65.8
Qwen3-4B-Thinking-2507-unsloth-bnb-4bit	medium	GPQA	qwen3-4b-thinking-2507	unsloth	91	Qwen/Qwen3-4B-Thinking-2507	65.8
Qwen3-4B-Thinking-2507-GGUF	medium	GPQA	qwen3-4b-thinking-2507	unsloth	92	Qwen/Qwen3-4B-Thinking-2507	65.8
Phi-4-reasoning-GGUF	high	Unknown	phi-4-reasoning	unsloth	93	microsoft/Phi-4-reasoning	65.8
Qwen3-4B-Thinking-2507	medium	GPQA	qwen3-4b-thinking-2507	unsloth	94	Qwen/Qwen3-4B-Thinking-2507	65.8
Qwen3-4B-Thinking-2507-bnb-4bit	medium	GPQA	qwen3-4b-thinking-2507	unsloth	95	Qwen/Qwen3-4B-Thinking-2507	65.8
DASD-4B-Thinking-GGUF	low	Unknown	Unknown	Mungert	96	—	65.8
Nanbeige4.1-3B-GGUF	medium	GPQA	nanbeige4-3b-base	Mungert	97	Nanbeige/Nanbeige4-3B-Base	65.8
Qwen3-4B-Thinking-2507-FP8	medium	GPQA	qwen3-4b-thinking-2507-fp8	unsloth	98	Qwen/Qwen3-4B-Thinking-2507-FP8	65.8
phi-4-reasoning	high	Unknown	phi-4-reasoning	unsloth	99	microsoft/phi-4-reasoning	65.8
phi-4-reasoning-unsloth-bnb-4bit	high	Unknown	phi-4-reasoning	unsloth	100	microsoft/phi-4-reasoning	65.8
phi-4-reasoning-bnb-4bit	high	Unknown	phi-4-reasoning	unsloth	101	microsoft/phi-4-reasoning	65.8
Phi-4-reasoning-plus-GGUF	high	Unknown	phi-4	Mungert	102	microsoft/phi-4	65.8
Phi-4-reasoning-plus	high	Unknown	phi-4-reasoning-plus	unsloth	103	microsoft/Phi-4-reasoning-plus	65.8
Phi-4-reasoning-GGUF	high	Unknown	phi-4	Mungert	104	microsoft/phi-4	65.8
Qwen3-4B-Thinking-2507-GGUF	medium	GPQA	qwen3-4b-thinking-2507	Mungert	105	Qwen/Qwen3-4B-Thinking-2507	65.8
Ring-mini-linear-2.0-GPTQ-int4	medium	GPQA	ring-mini-linear-2-0	inclusionAI	106	inclusionAI/Ring-mini-linear-2.0	65.69
Ring-flash-linear-2.0-GPTQ-int4	medium	GPQA	ring-mini-linear-2-0	inclusionAI	107	inclusionAI/Ring-mini-linear-2.0	65.69
r1-1776-distill-llama-70b-GGUF	medium	GPQA	Unknown	unsloth	108	perplexity-ai/r1-1776-distill-llama-70b	65.2
Nemotron-H-47B-Reasoning-128K	medium	GPQA	nemotron-h-47b-reasoning-128k	nvidia	109	nvidia/Nemotron-H-47B-Reasoning-128K	65.1
Nemotron-H-47B-Reasoning-128K-FP8	medium	GPQA	nemotron-h-47b-reasoning-128k	nvidia	110	nvidia/Nemotron-H-47B-Reasoning-128K	65.1
NVIDIA-Nemotron-Nano-12B-v2	medium	GPQA	nvidia-nemotron-nano-12b-v2-base	nvidia	111	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	64.48
NVIDIA-Nemotron-Nano-12B-v2-GGUF	medium	GPQA	nvidia-nemotron-nano-12b-v2-base	Mungert	112	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	64.48
Qwen3-14B-AWQ	low	Unknown	qwen3-14b	Qwen	113	Qwen/Qwen3-14B	64
Rubicon-Preview	low	Unknown	rubicon-preview	inclusionAI	114	inclusionAI/Rubicon-Preview	63
Qwen3-8B-AWQ	low	Unknown	qwen3-8b-base	Qwen	115	Qwen/Qwen3-8B	62
Nemotron-Research-GooseReason-4B-Instruct	low	Unknown	qwen3-4b-instruct-2507	nvidia	116	Qwen/Qwen3-4B-Instruct-2507	60.26
NVIDIA-Nemotron-Nano-9B-v2	medium	GPQA	nvidia-nemotron-nano-12b-v2-base	nvidia	117	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	59.6
NVIDIA-Nemotron-Nano-9B-v2-FP8	medium	GPQA	nvidia-nemotron-nano-12b-v2-base	nvidia	118	nvidia/NVIDIA-Nemotron-Nano-9B-v2	59.6
NVIDIA-Nemotron-Nano-9B-v2-NVFP4	medium	GPQA	nvidia-nemotron-nano-12b-v2-base	nvidia	119	nvidia/NVIDIA-Nemotron-Nano-9B-v2	59.6
NVIDIA-Nemotron-Nano-9B-v2	medium	GPQA	nvidia-nemotron-nano-12b-v2-base	unsloth	120	nvidia/NVIDIA-Nemotron-Nano-9B-v2	59.6
DeepSeek-V3-0324	medium	Unknown	deepseek-v3-0324	deepseek-ai	121	deepseek-ai/DeepSeek-V3-0324	59.1
DeepSeek-V3-0324-GGUF	medium	Unknown	deepseek-v3-0324	unsloth	122	deepseek-ai/DeepSeek-V3-0324	59.1
DeepSeek-V3-0324-GGUF-UD	medium	Unknown	deepseek-v3-0324	unsloth	123	deepseek-ai/DeepSeek-V3-0324	59.1
Olmo-3.1-32B-Think	medium	GPQA	olmo-3-32b-think-dpo	allenai	124	allenai/Olmo-3-32B-Think-DPO	57.5
Olmo-3.1-32B-Think-GGUF	medium	GPQA	olmo-3-1-32b-think	unsloth	125	allenai/Olmo-3.1-32B-Think	57.5
NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-BF16	medium	GPQA	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	126	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	57.39
NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-NVFP4	medium	GPQA	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	127	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	57.39
NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-FP8	medium	GPQA	nvidia-nemotron-3-nano-30b-a3b-bf16	nvidia	128	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16	57.39
LLaDA2.0-flash	medium	GPQA	llada2-0-flash	inclusionAI	129	inclusionAI/LLaDA2.0-flash	57.34
Qwen3-4B-AWQ	low	Unknown	qwen3-4b-base	Qwen	130	Qwen/Qwen3-4B	55.9
Olmo-3-32B-Think	medium	GPQA	olmo-3-32b-think-dpo	allenai	131	allenai/Olmo-3-32B-Think-DPO	55.7
Olmo-3-32B-Think-SFT	medium	GPQA	olmo-3-1125-32b	allenai	132	allenai/Olmo-3-1125-32B	55.7
Olmo-3-32B-Think-GGUF	medium	GPQA	olmo-3-32b-think-dpo	unsloth	133	allenai/Olmo-3-32B-Think	55.7
Olmo-3-32B-Think-DPO	medium	GPQA	olmo-3-32b-think-sft	allenai	134	allenai/Olmo-3-32B-Think-SFT	55.7
Olmo-3-32B-Think-unsloth-bnb-4bit	medium	GPQA	olmo-3-32b-think-dpo	unsloth	135	allenai/Olmo-3-32B-Think	55.7
Nemotron-H-8B-Reasoning-128K	medium	GPQA	nemotron-h-8b-reasoning-128k	nvidia	136	nvidia/Nemotron-H-8B-Reasoning-128K	53.5
Nemotron-H-8B-Reasoning-128K-FP8	medium	GPQA	nemotron-h-8b-reasoning-128k	nvidia	137	nvidia/Nemotron-H-8B-Reasoning-128K	53.5
NVIDIA-Nemotron-3-Nano-4B-BF16	medium	GPQA	nvidia-nemotron-nano-12b-v2-base	nvidia	138	nvidia/NVIDIA-Nemotron-Nano-9B-v2	53.2
NVIDIA-Nemotron-3-Nano-4B-FP8	medium	GPQA-D	nvidia-nemotron-nano-9b-v2	nvidia	139	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	53.2
NVIDIA-Nemotron-3-Nano-4B	medium	GPQA	nvidia-nemotron-nano-9b-v2	unsloth	140	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	53.2
NVIDIA-Nemotron-3-Nano-4B-GGUF	medium	GPQA	nvidia-nemotron-nano-9b-v2	unsloth	141	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	53.2
NVIDIA-Nemotron-3-Nano-4B-FP8	medium	GPQA	nvidia-nemotron-nano-9b-v2	unsloth	142	nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16	53.2
Qwen3-4B-Instruct-2507	medium	GPQA	qwen3-4b-instruct-2507	Qwen	143	Qwen/Qwen3-4B-Instruct-2507	50.3
Qwen3-4B-Instruct-2507-FP8	medium	GPQA	qwen3-4b-instruct-2507	Qwen	144	Qwen/Qwen3-4B-Instruct-2507	50.3
Qwen3-4B-Instruct-2507-GGUF	medium	GPQA	qwen3-4b-instruct-2507	unsloth	145	Qwen/Qwen3-4B-Instruct-2507	50.3
Qwen3-4B-Instruct-2507-unsloth-bnb-4bit	medium	GPQA	qwen3-4b-instruct-2507	unsloth	146	Qwen/Qwen3-4B-Instruct-2507	50.3
Qwen3-4B-Instruct-2507	medium	GPQA	qwen3-4b-instruct-2507	unsloth	147	Qwen/Qwen3-4B-Instruct-2507	50.3
Qwen3-4B-Instruct-2507-bnb-4bit	medium	GPQA	qwen3-4b-instruct-2507	unsloth	148	Qwen/Qwen3-4B-Instruct-2507	50.3
Qwen3-4B-Instruct-2507-GGUF	medium	GPQA	qwen3-4b-instruct-2507	Mungert	149	Qwen/Qwen3-4B-Instruct-2507	50.3
Qwen3-4B-Instruct-2507-FP8	medium	GPQA	qwen3-4b-instruct-2507-fp8	unsloth	150	Qwen/Qwen3-4B-Instruct-2507-FP8	50.3
NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	medium	GPQA	nvidia-nemotron-3-ultra-550b-a55b-base-bf16	nvidia	151	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	50
LLaDA2.0-mini	medium	GPQA	llada2-0-mini	inclusionAI	152	inclusionAI/LLaDA2.0-mini	46.59
MiniMax-Text-01-hf	medium	GPQA<sup>*</sup> _(diamond)_	minimax-text-01-hf	MiniMaxAI	153	MiniMaxAI/MiniMax-Text-01-hf	46
MiniMax-Text-01	medium	GPQA<sup>*</sup> _(diamond)_	minimax-text-01	MiniMaxAI	154	MiniMaxAI/MiniMax-Text-01	46
Mistral-Small-3.1-24B-Instruct-2503	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	mistralai	155	mistralai/Mistral-Small-3.1-24B-Base-2503	44.42
Mistral-Small-3.2-24B-Instruct-2506	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	mistralai	156	mistralai/Mistral-Small-3.1-24B-Base-2503	44.42
Mistral-Small-3.2-24B-Instruct-2506-GGUF	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	unsloth	157	mistralai/Mistral-Small-3.2-24B-Instruct-2506	44.42
Mistral-Small-3.2-24B-Instruct-2506-bnb-4bit	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	unsloth	158	mistralai/Mistral-Small-3.2-24B-Instruct-2506	44.42
Mistral-Small-3.2-24B-Instruct-2506	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	unsloth	159	mistralai/Mistral-Small-3.2-24B-Instruct-2506	44.42
Mistral-Small-3.1-24B-Instruct-2503-GGUF	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-instruct-2503	unsloth	160	mistralai/Mistral-Small-3.1-24B-Instruct-2503	44.42
Mistral-Small-3.2-24B-Instruct-2506-unsloth-bnb-4bit	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	unsloth	161	mistralai/Mistral-Small-3.2-24B-Instruct-2506	44.42
Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-instruct-2503	unsloth	162	mistralai/Mistral-Small-3.1-24B-Instruct-2503	44.42
Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-instruct-2503	unsloth	163	mistralai/Mistral-Small-3.1-24B-Instruct-2503	44.42
Mistral-Small-3.1-24B-Instruct-2503	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-instruct-2503	unsloth	164	mistralai/Mistral-Small-3.1-24B-Instruct-2503	44.42
Mistral-Small-3.1-24B-Instruct-2503-GGUF	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	Mungert	165	mistralai/Mistral-Small-3.1-24B-Base-2503	44.42
Mistral-Small-3.2-24B-Instruct-2506-GGUF	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	Mungert	166	mistralai/Mistral-Small-3.1-24B-Base-2503	44.42
Mistral-Small-3.2-24B-Instruct-2506-FP8	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT) \| GPQA Diamond (5-shot CoT )	mistral-small-3-1-24b-base-2503	unsloth	167	mistralai/Mistral-Small-3.2-24B-Instruct-2506	44.42
Falcon-H1-34B-Base	medium	GPQA	falcon-h1-34b-base	tiiuae	168	tiiuae/Falcon-H1-34B-Base	42.7
Ling-2.6-1T-base	medium	GPQA	ling-2-6-1t	inclusionAI	169	inclusionAI/Ling-2.6-1T	41.92
Qwen2-72B-Instruct	medium	GPQA	qwen2-72b	Qwen	170	Qwen/Qwen2-72B	41.9
Falcon-H1-34B-Instruct	medium	GPQA	falcon-h1-34b-base	tiiuae	171	tiiuae/Falcon-H1-34B-Base	41.53
Falcon-H1-34B-Instruct-GGUF	medium	GPQA	falcon-h1-34b-instruct	tiiuae	172	tiiuae/Falcon-H1-34B-Instruct	41.53
Falcon-H1-34B-Instruct-GGUF	medium	GPQA	falcon-h1-34b-instruct	unsloth	173	tiiuae/Falcon-H1-34B-Instruct	41.53
Falcon-H1-34B-Instruct-GPTQ-Int4	medium	GPQA	falcon-h1-34b-instruct	tiiuae	174	tiiuae/Falcon-H1-34B-Instruct	41.53
Olmo-3.1-32B-Instruct	medium	GPQA	olmo-3-1-32b-instruct-dpo	allenai	175	allenai/Olmo-3.1-32B-Instruct-DPO	41.3
Olmo-3.1-32B-Instruct-SFT	medium	GPQA	olmo-3-1125-32b	allenai	176	allenai/Olmo-3-1125-32B	41.3
Olmo-3.1-32B-Instruct-DPO	medium	GPQA	olmo-3-1-32b-instruct-sft	allenai	177	allenai/Olmo-3.1-32B-Instruct-SFT	41.3
Olmo-3.1-32B-Instruct-GGUF	medium	GPQA	olmo-3-1-32b-instruct	unsloth	178	allenai/Olmo-3.1-32B-Instruct	41.3
Olmo-3.1-32B-Instruct	medium	GPQA	olmo-3-1-32b-instruct	unsloth	179	allenai/Olmo-3.1-32B-Instruct	41.3
Ling-lite	medium	GPQA(Pass@1)	ling-lite	inclusionAI	180	inclusionAI/Ling-lite	40.91
Qwen3-4B-SafeRL	high	Unknown	qwen3-4b-base	Qwen	181	Qwen/Qwen3-4B	40.8
Qwen3-1.7B-GPTQ-Int8	low	Unknown	qwen3-1-7b-base	Qwen	182	Qwen/Qwen3-1.7B	40.1
LFM2.5-1.2B-Instruct-GGUF	low	Unknown	lfm2-5-1-2b-base	unsloth	183	LiquidAI/LFM2.5-1.2B-Instruct	38.89
LFM2.5-1.2B-Instruct	low	Unknown	lfm2-5-1-2b-base	unsloth	184	LiquidAI/LFM2.5-1.2B-Instruct	38.89
LFM2.5-1.2B-Instruct-GGUF	low	Unknown	lfm2-5-1-2b-base	Mungert	185	LiquidAI/LFM2.5-1.2B-Base	38.89
OpenThinker3-7B-GGUF	low	Unknown	qwen2-5-7b-instruct	Mungert	186	Qwen/Qwen2.5-7B-Instruct	38.6
internlm2_5-7b-chat	medium	GPQA (0-shot)	internlm2-5-7b-chat	internlm	187	internlm/internlm2_5-7b-chat	38.4
ZR1-1.5B-GGUF	high	Unknown	deepseek-r1-distill-qwen-1-5b	Mungert	188	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	37.91
internlm2_5-20b	medium	GPQA	internlm2-5-20b	internlm	189	internlm/internlm2_5-20b	37.88
Mistral-Small-3.1-24B-Instruct-2503	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT)	mistral-small-3-1-24b-base-2503	mistralai	190	mistralai/Mistral-Small-3.1-24B-Base-2503	37.5
Mistral-Small-3.1-24B-Instruct-2503-GGUF	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT)	mistral-small-3-1-24b-instruct-2503	unsloth	191	mistralai/Mistral-Small-3.1-24B-Instruct-2503	37.5
Mistral-Small-3.1-24B-Base-2503	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT)	mistral-small-3-1-24b-base-2503	mistralai	192	mistralai/Mistral-Small-3.1-24B-Base-2503	37.5
Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT)	mistral-small-3-1-24b-instruct-2503	unsloth	193	mistralai/Mistral-Small-3.1-24B-Instruct-2503	37.5
Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT)	mistral-small-3-1-24b-instruct-2503	unsloth	194	mistralai/Mistral-Small-3.1-24B-Instruct-2503	37.5
Mistral-Small-3.1-24B-Instruct-2503	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT)	mistral-small-3-1-24b-instruct-2503	unsloth	195	mistralai/Mistral-Small-3.1-24B-Instruct-2503	37.5
Mistral-Small-3.1-24B-Instruct-2503-GGUF	low	MMLU Pro (5-shot CoT) \| GPQA Main (5-shot CoT)	mistral-small-3-1-24b-base-2503	Mungert	196	mistralai/Mistral-Small-3.1-24B-Base-2503	37.5
Falcon-H1-7B-Base	medium	GPQA	falcon-h1-7b-base	tiiuae	197	tiiuae/Falcon-H1-7B-Base	36.58
Ling-lite-1.5	medium	GPQA(Pass@1)	ling-lite-1-5	inclusionAI	198	inclusionAI/Ling-lite-1.5	36.55
Falcon-H1-7B-Instruct	medium	GPQA	falcon-h1-7b-base	tiiuae	199	tiiuae/Falcon-H1-7B-Base	36.33
Falcon-H1-7B-Instruct-GPTQ-Int4	medium	GPQA	falcon-h1-7b-instruct	tiiuae	200	tiiuae/Falcon-H1-7B-Instruct	36.33
Falcon-H1-7B-Instruct-GGUF	medium	GPQA	falcon-h1-7b-instruct	tiiuae	201	tiiuae/Falcon-H1-7B-Instruct	36.33
Falcon-H1-7B-Instruct-GGUF	medium	GPQA	falcon-h1-7b-instruct	unsloth	202	tiiuae/Falcon-H1-7B-Instruct	36.33
Ling-2.6-flash-base	medium	GPQA	ling-2-6-flash	inclusionAI	203	inclusionAI/Ling-2.6-flash	35.35
Mistral-Small-24B-Base-2501	medium	[GPQA Main][]	mistral-small-24b-base-2501	mistralai	204	mistralai/Mistral-Small-24B-Base-2501	34.37
Qwen2-72B	medium	GPQA	qwen2-72b	Qwen	205	Qwen/Qwen2-72B	34.3
glm-4-9b	high	Unknown	glm-4-9b	zai-org	206	zai-org/glm-4-9b	34.3
glm-4-9b-hf	high	Unknown	glm-4-9b-hf	zai-org	207	zai-org/glm-4-9b-hf	34.3
Qwen2-7B-Instruct	medium	GPQA	qwen2-7b	Qwen	208	Qwen/Qwen2-7B	34.2
Falcon-H1-3B-Instruct	medium	GPQA	falcon-h1-3b-base	tiiuae	209	tiiuae/Falcon-H1-3B-Base	33.89
Falcon-H1-3B-Instruct-GGUF	medium	GPQA	falcon-h1-3b-base	tiiuae	210	tiiuae/Falcon-H1-3B-Base	33.89
Falcon-H1-3B-Instruct-GGUF	medium	GPQA	falcon-h1-3b-instruct	unsloth	211	tiiuae/Falcon-H1-3B-Instruct	33.89
internlm2_5-20b-chat	medium	GPQA (0-shot)	internlm2-5-20b-chat	internlm	212	internlm/internlm2_5-20b-chat	33.3
Falcon-H1-1.5B-Deep-Instruct	medium	GPQA	falcon-h1-1-5b-deep-base	tiiuae	213	tiiuae/Falcon-H1-1.5B-Deep-Base	33.22
Falcon-H1-1.5B-Deep-Instruct-GGUF	medium	GPQA	falcon-h1-1-5b-deep-instruct	tiiuae	214	tiiuae/Falcon-H1-1.5B-Deep-Instruct	33.22
Falcon-H1-1.5B-Deep-Instruct-GGUF	medium	GPQA	falcon-h1-1-5b-deep-instruct	unsloth	215	tiiuae/Falcon-H1-1.5B-Deep-Instruct	33.22
Falcon-H1-1.5B-Deep-Instruct	medium	GPQA	falcon-h1-1-5b-deep-instruct	unsloth	216	tiiuae/Falcon-H1-1.5B-Deep-Instruct	33.22
Falcon-H1-1.5B-Deep-Instruct-GPTQ-Int4	medium	GPQA	falcon-h1-1-5b-deep-instruct	tiiuae	217	tiiuae/Falcon-H1-1.5B-Deep-Instruct	33.22
Falcon-H1-1.5B-Deep-Base	medium	GPQA	falcon-h1-1-5b-deep-base	tiiuae	218	tiiuae/Falcon-H1-1.5B-Deep-Base	32.8
Falcon-H1-3B-Base	medium	GPQA	falcon-h1-3b-base	tiiuae	219	tiiuae/Falcon-H1-3B-Base	32.63
OpenReasoning-Nemotron-32B	low	Unknown	qwen2-5-32b	nvidia	220	Qwen/Qwen2.5-32B	31.6
OpenReasoning-Nemotron-1.5B	low	Unknown	qwen2-5-1-5b	nvidia	221	Qwen/Qwen2.5-1.5B	31.6
OpenReasoning-Nemotron-14B	low	Unknown	qwen2-5-14b	nvidia	222	Qwen/Qwen2.5-14B	31.6
OpenReasoning-Nemotron-7B	low	Unknown	qwen2-5-7b	nvidia	223	Qwen/Qwen2.5-7B	31.6
OpenReasoning-Nemotron-32B-GGUF	low	Unknown	qwen2-5-32b	unsloth	224	nvidia/OpenReasoning-Nemotron-32B	31.6
OpenReasoning-Nemotron-7B-GGUF	low	Unknown	qwen2-5-7b-instruct	Mungert	225	Qwen/Qwen2.5-7B-Instruct	31.6
OpenReasoning-Nemotron-1.5B-GGUF	low	Unknown	qwen2-5-1-5b-instruct	Mungert	226	Qwen/Qwen2.5-1.5B-Instruct	31.6
OpenReasoning-Nemotron-14B-GGUF	low	Unknown	qwen2-5-14b	Mungert	227	Qwen/Qwen2.5-14B-Instruct	31.6
OpenReasoning-Nemotron-32B-GGUF	low	Unknown	qwen2-5-32b-instruct	Mungert	228	Qwen/Qwen2.5-32B-Instruct	31.6
LFM2-1.2B-GGUF	high	Unknown	lfm2-1-2b	unsloth	229	LiquidAI/LFM2-1.2B	31.47
LFM2-1.2B-unsloth-bnb-4bit	high	Unknown	lfm2-1-2b	unsloth	230	LiquidAI/LFM2-1.2B	31.47
LFM2-1.2B	high	Unknown	lfm2-1-2b	unsloth	231	LiquidAI/LFM2-1.2B	31.47
internlm2_5-7b	medium	GPQA	internlm2-5-7b	internlm	232	internlm/internlm2_5-7b	31.3
Qwen2.5-Omni-3B	medium	GPQA	qwen2-5-omni-3b	Qwen	233	Qwen/Qwen2.5-Omni-3B	30.8
Qwen2.5-Omni-7B	medium	GPQA	qwen2-5-omni-7b	Qwen	234	Qwen/Qwen2.5-Omni-7B	30.8
Qwen2-57B-A14B-Instruct	medium	GPQA	qwen2-57b-a14b	Qwen	235	Qwen/Qwen2-57B-A14B	30.8
Qwen2.5-Omni-7B-GGUF	medium	GPQA	qwen2-5-omni-7b	unsloth	236	Qwen/Qwen2.5-Omni-7B	30.8
Qwen2.5-Omni-3B-GGUF	medium	GPQA	qwen2-5-omni-3b	unsloth	237	Qwen/Qwen2.5-Omni-3B	30.8
Qwen2.5-Omni-3B-GGUF	medium	GPQA	qwen2-5-omni-3b	Mungert	238	Qwen/Qwen2.5-Omni-3B	30.8
Qwen2.5-Omni-7B	medium	GPQA	qwen2-5-omni-7b	unsloth	239	Qwen/Qwen2.5-Omni-7B	30.8
Qwen2.5-Omni-7B-GGUF	medium	GPQA	qwen2-5-omni-7b	Mungert	240	Qwen/Qwen2.5-Omni-7B	30.8
Qwen2.5-Omni-3B	medium	GPQA	qwen2-5-omni-3b	unsloth	241	Qwen/Qwen2.5-Omni-3B	30.8
Falcon-H1-0.5B-Instruct	medium	GPQA	falcon-h1-0-5b-base	tiiuae	242	tiiuae/Falcon-H1-0.5B-Base	29.95
Falcon-H1-0.5B-Instruct-GGUF	medium	GPQA	falcon-h1-0-5b-base	tiiuae	243	tiiuae/Falcon-H1-0.5B-Base	29.95
Falcon-H1-0.5B-Instruct-GGUF	medium	GPQA	falcon-h1-0-5b-instruct	unsloth	244	tiiuae/Falcon-H1-0.5B-Instruct	29.95
Falcon-H1-0.5B-Base	medium	GPQA	falcon-h1-0-5b-base	tiiuae	245	tiiuae/Falcon-H1-0.5B-Base	29.7
LFM2-8B-A1B-GGUF	low	Unknown	lfm2-8b-a1b	unsloth	246	LiquidAI/LFM2-8B-A1B	29.29
LFM2-8B-A1B	low	Unknown	lfm2-8b-a1b	unsloth	247	LiquidAI/LFM2-8B-A1B	29.29
Qwen2-57B-A14B	medium	GPQA	qwen2-57b-a14b	Qwen	248	Qwen/Qwen2-57B-A14B	29.2
Falcon-H1-1.5B-Base	medium	GPQA	falcon-h1-1-5b-base	tiiuae	249	tiiuae/Falcon-H1-1.5B-Base	29.11
LFM2-700M	high	Unknown	lfm2-700m	unsloth	250	LiquidAI/LFM2-700M	28.48
LFM2-700M-GGUF	high	Unknown	lfm2-700m	unsloth	251	LiquidAI/LFM2-700M	28.48
Qwen3-0.6B-GPTQ-Int8	low	Unknown	qwen3-0-6b-base	Qwen	252	Qwen/Qwen3-0.6B	27.9
internlm2_5-1_8b-chat	medium	GPQA (0-shot)	internlm2-5-1-8b-chat	internlm	253	internlm/internlm2_5-1_8b-chat	27.8
Hunyuan-7B-Instruct-GGUF	medium	GPQA	hunyuan-7b-pretrain	Mungert	254	tencent/Hunyuan-7B-Pretrain	27.76
LFM2-350M	high	Unknown	lfm2-350m	unsloth	255	LiquidAI/LFM2-350M	27.46
LFM2-350M-GGUF	high	Unknown	lfm2-350m	unsloth	256	LiquidAI/LFM2-350M	27.46
LFM2-350M-unsloth-bnb-4bit	high	Unknown	lfm2-350m	unsloth	257	LiquidAI/LFM2-350M	27.46
LFM2-2.6B-GGUF	high	Unknown	lfm2-2-6b	Mungert	258	LiquidAI/LFM2-2.6B	26.57
Falcon-H1-1.5B-Instruct	medium	GPQA	falcon-h1-1-5b-base	tiiuae	259	tiiuae/Falcon-H1-1.5B-Base	26.34
Falcon-H1-1.5B-Instruct-GGUF	medium	GPQA	falcon-h1-1-5b-instruct	tiiuae	260	tiiuae/Falcon-H1-1.5B-Instruct	26.34
Falcon-H1-1.5B-Instruct-GGUF	medium	GPQA	falcon-h1-1-5b-instruct	unsloth	261	tiiuae/Falcon-H1-1.5B-Instruct	26.34
Falcon-H1-1.5B-Instruct-GPTQ-Int4	medium	GPQA	falcon-h1-1-5b-instruct	tiiuae	262	tiiuae/Falcon-H1-1.5B-Instruct	26.34
Falcon-H1-1.5B-Instruct-GPTQ-Int8	medium	GPQA	falcon-h1-1-5b-instruct	tiiuae	263	tiiuae/Falcon-H1-1.5B-Instruct	26.34
Phi-3-mini-128k-instruct	medium	GPQA	Unknown	microsoft	264	microsoft/Phi-3-mini-128k-instruct	25.9
Phi-4-mini-instruct	medium	GPQA (0-shot, CoT)	phi-4-mini-instruct	microsoft	265	microsoft/Phi-4-mini-instruct	25.2
Phi-4-mini-instruct-GGUF	medium	GPQA (0-shot, CoT)	phi-4-mini-instruct	unsloth	266	microsoft/Phi-4-mini-instruct	25.2
Phi-4-mini-instruct-unsloth-bnb-4bit	medium	GPQA (0-shot, CoT)	phi-4-mini-instruct	unsloth	267	microsoft/Phi-4-mini-instruct	25.2
Phi-4-mini-instruct-bnb-4bit	medium	GPQA (0-shot, CoT)	phi-4-mini-instruct	unsloth	268	microsoft/Phi-4-mini-instruct	25.2
Phi-4-mini-instruct	medium	GPQA (0-shot, CoT)	phi-4-mini-instruct	unsloth	269	microsoft/Phi-4-mini-instruct	25.2
Phi-4-mini-instruct-GGUF	medium	GPQA (0-shot, CoT)	phi-4-mini-instruct	Mungert	270	microsoft/Phi-4-mini-instruct	25.2
Hunyuan-A13B-Instruct-GGUF	medium	GPQA	hunyuan-a13b-instruct	unsloth	271	tencent/Hunyuan-A13B-Instruct	25.18
gemma-3n-E2B-it	medium	[GPQA][] Diamond	gemma-3n-e4b	google	272	google/gemma-3n-E4B-it	24.8
gemma-3n-E4B-it	medium	[GPQA][] Diamond	gemma-3n-e4b	google	273	google/gemma-3n-E4B	24.8
gemma-3n-E4B-it-litert-lm	medium	[GPQA][] Diamond	Unknown	google	274	google/gemma-3n-E4B-it-litert-lm	24.8
gemma-3n-E2B-it-GGUF	medium	[GPQA][] Diamond	gemma-3n-e2b-it	unsloth	275	google/gemma-3n-E2B-it	24.8
gemma-3n-E4B-it	medium	[GPQA][] Diamond	gemma-3n-e4b	unsloth	276	google/gemma-3n-E4B-it	24.8
gemma-3n-E2B	medium	[GPQA][] Diamond	gemma-3n-e4b	google	277	google/gemma-3n-E4B	24.8
gemma-3n-E2B-it-litert-lm	medium	[GPQA][] Diamond	Unknown	google	278	google/gemma-3n-E2B-it-litert-lm	24.8
gemma-3n-E4B-it-GGUF	medium	[GPQA][] Diamond	gemma-3n-e4b	unsloth	279	google/gemma-3n-E4B-it	24.8
gemma-3n-E4B	medium	[GPQA][] Diamond	gemma-3n-e4b	google	280	google/gemma-3n-E4B	24.8
gemma-3n-E2B-it-unsloth-bnb-4bit	medium	[GPQA][] Diamond	gemma-3n-e2b-it	unsloth	281	google/gemma-3n-E2B-it	24.8
gemma-3n-E2B-it-litert-preview-GGUF	medium	[GPQA][] Diamond	Unknown	unsloth	282	google/gemma-3n-E2B-it-litert-preview	24.8
gemma-3n-E4B-it-litert-preview-GGUF	medium	[GPQA][] Diamond	Unknown	unsloth	283	google/gemma-3n-E4B-it-litert-preview	24.8
gemma-3n-E4B-unsloth-bnb-4bit	medium	[GPQA][] Diamond	gemma-3n-e4b	unsloth	284	google/gemma-3n-E4B-it	24.8
gemma-3n-E2B-it-ONNX	medium	[GPQA][] Diamond	gemma-3n-e2b-it	onnx-community	285	google/gemma-3n-E2B-it	24.8
gemma-3n-E4B-it-GGUF	medium	[GPQA][] Diamond	gemma-3n-e4b	Mungert	286	google/gemma-3n-E4B	24.8
gemma-3n-E4B-it-absolute-heresy-MPOA-imatrix-GGUF	medium	[GPQA][] Diamond	gemma-3n-e4b-it-absolute-heresy-mpoa	MuXodious	287	MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA	24.8
gemma-3n-E4B-it-absolute-heresy-GGUF	medium	[GPQA][] Diamond	gemma-3n-e4b	MuXodious	288	google/gemma-3n-E4B-it	24.8
gemma-3n-E4B-it-absolute-heresy-MPOA-GGUF	medium	[GPQA][] Diamond	gemma-3n-e4b-it-absolute-heresy-mpoa	MuXodious	289	MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA	24.8
gemma-3n-E2B-it-GGUF	medium	[GPQA][] Diamond	gemma-3n-e4b	Mungert	290	google/gemma-3n-E4b-it	24.8
Qwen2-7B	medium	GPQA	qwen2-7b	Qwen	291	Qwen/Qwen2-7B	24.7
internlm2_5-1_8b	medium	GPQA	Unknown	internlm	292	internlm/internlm2_5-1_8b	24.24
Phi-3-mini-4k-instruct	medium	GPQA	Unknown	microsoft	293	microsoft/Phi-3-mini-4k-instruct	23.7
Falcon-E-3B-Instruct	high	Unknown	falcon-e-3b-instruct	tiiuae	294	tiiuae/Falcon-E-3B-Instruct	23.59
Falcon-E-3B-Instruct-GGUF	high	Unknown	falcon-e-3b-base	tiiuae	295	tiiuae/Falcon-E-3B-Base	23.59
gemma-3-270m	medium	[GPQA][] Diamond	gemma-3-270m	google	296	google/gemma-3-270m	19.2
gemma-3-270m-it	medium	[GPQA][] Diamond	gemma-3-270m	google	297	google/gemma-3-270m	19.2
gemma-3-270m-it-GGUF	medium	[GPQA][] Diamond	gemma-3-270m-it	unsloth	298	google/gemma-3-270m-it	19.2
gemma-3-270m-it	medium	[GPQA][] Diamond	gemma-3-270m-it	unsloth	299	google/gemma-3-270m-it	19.2
gemma-3-270m-it-unsloth-bnb-4bit	medium	[GPQA][] Diamond	gemma-3-270m-it	unsloth	300	google/gemma-3-270m-it	19.2
gemma-3-270m-it-qat-GGUF	medium	[GPQA][] Diamond	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	301	google/gemma-3-270m-it-qat-q4_0-unquantized	19.2
gemma-3-270m	medium	[GPQA][] Diamond	gemma-3-270m	unsloth	302	google/gemma-3-270m	19.2
gemma-3-270m-unsloth-bnb-4bit	medium	[GPQA][] Diamond	gemma-3-270m-it	unsloth	303	google/gemma-3-270m-it	19.2
gemma-3-270m-it-qat-q4_0-unquantized	medium	[GPQA][] Diamond	gemma-3-270m-it	google	304	google/gemma-3-270m-it	19.2
gemma-3-270m-it-bnb-4bit	medium	[GPQA][] Diamond	gemma-3-270m-it	unsloth	305	google/gemma-3-270m-it	19.2
gemma-3-270m-it-qat	medium	[GPQA][] Diamond	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	306	google/gemma-3-270m-it-qat-q4_0-unquantized	19.2
gemma-3-270m-bnb-4bit	medium	[GPQA][] Diamond	gemma-3-270m	unsloth	307	google/gemma-3-270m	19.2
gemma-3-270m-qat-q4_0-unquantized	medium	[GPQA][] Diamond	gemma-3-270m	google	308	google/gemma-3-270m	19.2
gemma-3-270m-it-GGUF	medium	[GPQA][] Diamond	gemma-3-270m	Mungert	309	google/gemma-3-270m	19.2
gemma-3-270m-it-torchao-FP8	medium	[GPQA][] Diamond	gemma-3-270m-it	unsloth	310	google/gemma-3-270m-it	19.2
WizardLM-2-8x22B	medium	GPQA (0-shot)	Unknown	alpindale	311	—	17.56
Falcon-E-1B-Instruct-GGUF	high	Unknown	falcon-e-1b-base	tiiuae	312	tiiuae/Falcon-E-1B-Base	16.5
Falcon-E-1B-Instruct	high	Unknown	falcon-e-1b-instruct	tiiuae	313	tiiuae/Falcon-E-1B-Instruct	16.5
Nemotron-Research-Reasoning-Qwen-1.5B	low	Unknown	deepseek-r1-distill-qwen-1-5b	nvidia	314	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	15.86
Nemotron-Research-Reasoning-Qwen-1.5B-GGUF	low	Unknown	deepseek-r1-distill-qwen-1-5b	Mungert	315	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	15.86
gemma-3-1b-it	medium	[GPQA][]	gemma-3-1b-pt	google	316	google/gemma-3-1b-pt	15
gemma-3-4b-it	medium	[GPQA][]	gemma-3-4b-pt	google	317	google/gemma-3-4b-pt	15
gemma-3-270m	medium	[GPQA][]	gemma-3-270m	google	318	google/gemma-3-270m	15
gemma-3-12b-it	medium	[GPQA][]	gemma-3-12b-pt	google	319	google/gemma-3-12b-pt	15
gemma-3-27b-it	medium	[GPQA][]	gemma-3-27b-pt	google	320	google/gemma-3-27b-pt	15
gemma-3-270m-it	medium	[GPQA][]	gemma-3-270m	google	321	google/gemma-3-270m	15
gemma-3-4b-it	medium	[GPQA][]	gemma-3-4b-pt	unsloth	322	google/gemma-3-4b-it	15
gemma-3-1b-it-GGUF	medium	[GPQA][]	gemma-3-1b-pt	ggml-org	323	google/gemma-3-1b-it	15
gemma-3-12b-it-qat-q4_0-unquantized	medium	[GPQA][]	gemma-3-12b-pt	google	324	google/gemma-3-12b-it	15
gemma-3-1b-it	medium	[GPQA][]	gemma-3-1b-pt	unsloth	325	google/gemma-3-1b-it	15
gemma-3-270m-it-GGUF	medium	[GPQA][]	gemma-3-270m-it	unsloth	326	google/gemma-3-270m-it	15
gemma-3-12b-it-GGUF	medium	[GPQA][]	gemma-3-12b-pt	unsloth	327	google/gemma-3-12b-it	15
gemma-3-4b-pt	medium	[GPQA][]	gemma-3-4b-pt	google	328	google/gemma-3-4b-pt	15
gemma-3-12b-it-qat-GGUF	medium	[GPQA][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	329	google/gemma-3-12b-it-qat-q4_0-unquantized	15
gemma-3-27b-it	medium	[GPQA][]	gemma-3-27b-it	unsloth	330	google/gemma-3-27b-it	15
gemma-3-1b-pt	medium	[GPQA][]	gemma-3-1b-pt	google	331	google/gemma-3-1b-pt	15
gemma-3-4b-it-GGUF	medium	[GPQA][]	gemma-3-4b-pt	ggml-org	332	google/gemma-3-4b-it	15
gemma-3-4b-it-GGUF	medium	[GPQA][]	gemma-3-4b-pt	unsloth	333	google/gemma-3-4b-it	15
gemma-3-1b-it-GGUF	medium	[GPQA][]	gemma-3-1b-pt	unsloth	334	google/gemma-3-1b-it	15
gemma-3-12b-pt	medium	[GPQA][]	Unknown	google	335	google/gemma-3-12b	15
gemma-3-12b-it-unsloth-bnb-4bit	medium	[GPQA][]	gemma-3-12b-pt	unsloth	336	google/gemma-3-12b-it	15
gemma-3-4b-it-unsloth-bnb-4bit	medium	[GPQA][]	gemma-3-4b-pt	unsloth	337	google/gemma-3-4b-it	15
gemma-3-12b-it	medium	[GPQA][]	gemma-3-12b-pt	unsloth	338	google/gemma-3-12b-pt	15
gemma-3-270m-it	medium	[GPQA][]	gemma-3-270m-it	unsloth	339	google/gemma-3-270m-it	15
gemma-3-27b-it-GGUF	medium	[GPQA][]	gemma-3-27b-it	unsloth	340	google/gemma-3-27b-it	15
gemma-3-1b-it-unsloth-bnb-4bit	medium	[GPQA][]	gemma-3-1b-pt	unsloth	341	google/gemma-3-1b-it	15
gemma-3-4b-it-bnb-4bit	medium	[GPQA][]	gemma-3-4b-pt	unsloth	342	google/gemma-3-4b-it	15
gemma-3-4b-pt	medium	[GPQA][]	gemma-3-4b-pt	unsloth	343	google/gemma-3-4b-pt	15
gemma-3-27b-pt	medium	[GPQA][]	gemma-3-27b-pt	google	344	google/gemma-3-27b-pt	15
gemma-3-12b-it-bnb-4bit	medium	[GPQA][]	gemma-3-12b-pt	unsloth	345	google/gemma-3-12b-it	15
gemma-3-270m-it-unsloth-bnb-4bit	medium	[GPQA][]	gemma-3-270m-it	unsloth	346	google/gemma-3-270m-it	15
gemma-3-27b-it-GGUF	medium	[GPQA][]	gemma-3-27b-it	ggml-org	347	google/gemma-3-27b-it	15
gemma-3-12b-pt	medium	[GPQA][]	gemma-3-12b-pt	unsloth	348	google/gemma-3-12b-pt	15
gemma-3-27b-it-bnb-4bit	medium	[GPQA][]	gemma-3-27b-it	unsloth	349	google/gemma-3-27b-it	15
gemma-3-27b-it-unsloth-bnb-4bit	medium	[GPQA][]	gemma-3-27b-it	unsloth	350	google/gemma-3-27b-it	15
gemma-3-1b-pt	medium	[GPQA][]	gemma-3-1b-pt	unsloth	351	google/gemma-3-1b-pt	15
gemma-3-12b-it-GGUF	medium	[GPQA][]	gemma-3-12b-pt	ggml-org	352	google/gemma-3-12b-it	15
gemma-3-4b-it-qat-GGUF	medium	[GPQA][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	353	google/gemma-3-4b-it-qat-q4_0-unquantized	15
gemma-3-270m-it-qat-GGUF	medium	[GPQA][]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	354	google/gemma-3-270m-it-qat-q4_0-unquantized	15
gemma-3-12b-it-qat-bnb-4bit	medium	[GPQA][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	355	google/gemma-3-12b-it-qat-q4_0-unquantized	15
gemma-3-270m	medium	[GPQA][]	gemma-3-270m	unsloth	356	google/gemma-3-270m	15
gemma-3-12b-it-qat-int4-GGUF	medium	[GPQA][]	gemma-3-12b-it-qat-int4-unquantized	unsloth	357	google/gemma-3-12b-it-qat-int4-unquantized	15
gemma-3-4b-it-qat-q4_0-gguf	medium	[GPQA][]	gemma-3-4b-pt	google	358	google/gemma-3-4b-it	15
gemma-3-4b-it-qat-q4_0-unquantized	medium	[GPQA][]	gemma-3-4b-pt	google	359	google/gemma-3-4b-it	15
gemma-3-4b-pt-bnb-4bit	medium	[GPQA][]	gemma-3-4b-pt	unsloth	360	google/gemma-3-4b-pt	15
gemma-3-27b-it-qat-GGUF	medium	[GPQA][]	gemma-3-27b-it-qat-q4-0-unquantized	unsloth	361	google/gemma-3-27b-it-qat-q4_0-unquantized	15
gemma-3-12b-it-qat-q4_0-gguf	medium	[GPQA][]	gemma-3-12b-pt	google	362	google/gemma-3-12b-it	15
gemma-3-1b-it-bnb-4bit	medium	[GPQA][]	gemma-3-1b-pt	unsloth	363	google/gemma-3-1b-it	15
gemma-3-1b-it-qat-q4_0-gguf	medium	[GPQA][]	gemma-3-1b-pt	google	364	google/gemma-3-1b-it	15
gemma-3-4b-pt-unsloth-bnb-4bit	medium	[GPQA][]	gemma-3-4b-pt	unsloth	365	google/gemma-3-4b-pt	15
gemma-3-270m-unsloth-bnb-4bit	medium	[GPQA][]	gemma-3-270m-it	unsloth	366	google/gemma-3-270m-it	15
gemma-3-12b-it-qat	medium	[GPQA][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	367	google/gemma-3-12b-it-qat-q4_0-unquantized	15
gemma-3-1b-pt-unsloth-bnb-4bit	medium	[GPQA][]	gemma-3-1b-pt	unsloth	368	google/gemma-3-1b-pt	15
gemma-3-4b-it-FP8-Dynamic	medium	[GPQA][]	gemma-3-4b-pt	unsloth	369	google/gemma-3-4b-it	15
gemma-3-270m-it-qat-q4_0-unquantized	medium	[GPQA][]	gemma-3-270m-it	google	370	google/gemma-3-270m-it	15
gemma-3-12b-pt-bnb-4bit	medium	[GPQA][]	gemma-3-12b-pt	unsloth	371	google/gemma-3-12b-pt	15
gemma-3-12b-it-qat-int4-unquantized	medium	[GPQA][]	gemma-3-12b-pt	google	372	google/gemma-3-12b-it	15
gemma-3-27b-it-GGUF	medium	[GPQA][]	gemma-3-27b-pt	Mungert	373	google/gemma-3-27b-pt	15
gemma-3-27b-it-qat-q4_0-unquantized	medium	[GPQA][]	gemma-3-27b-it	google	374	google/gemma-3-27b-it	15
gemma-3-12b-pt-unsloth-bnb-4bit	medium	[GPQA][]	gemma-3-12b-pt	unsloth	375	google/gemma-3-12b-pt	15
gemma-3-270m-it-bnb-4bit	medium	[GPQA][]	gemma-3-270m-it	unsloth	376	google/gemma-3-270m-it	15
gemma-3-27b-it-qat-q4_0-gguf	medium	[GPQA][]	gemma-3-27b-it	google	377	google/gemma-3-27b-it	15
gemma-3-27b-it-qat-q4_0-GGUF	medium	[GPQA][]	gemma-3-27b-it	Mungert	378	google/gemma-3-27b-it	15
gemma-3-270m-it-qat	medium	[GPQA][]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	379	google/gemma-3-270m-it-qat-q4_0-unquantized	15
gemma-3-4b-it-qat-bnb-4bit	medium	[GPQA][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	380	google/gemma-3-4b-it-qat-q4_0-unquantized	15
gemma-3-1b-pt-bnb-4bit	medium	[GPQA][]	gemma-3-1b-pt	unsloth	381	google/gemma-3-1b-pt	15
gemma-3-27b-pt	medium	[GPQA][]	gemma-3-27b-pt	unsloth	382	google/gemma-3-27b-pt	15
gemma-3-12b-it-FP8-Dynamic	medium	[GPQA][]	gemma-3-12b-pt	unsloth	383	google/gemma-3-12b-pt	15
gemma-3-270m-bnb-4bit	medium	[GPQA][]	gemma-3-270m	unsloth	384	google/gemma-3-270m	15
gemma-3-1b-it-qat-int4-unquantized	medium	[GPQA][]	gemma-3-1b-pt	google	385	google/gemma-3-1b-it	15
gemma-3-27b-pt-bnb-4bit	medium	[GPQA][]	gemma-3-27b-pt	unsloth	386	google/gemma-3-27b-pt	15
gemma-3-12b-it-qat-unsloth-bnb-4bit	medium	[GPQA][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	387	google/gemma-3-12b-it-qat-q4_0-unquantized	15
gemma-3-270m-qat-q4_0-unquantized	medium	[GPQA][]	gemma-3-270m	google	388	google/gemma-3-270m	15
gemma-3-12b-pt-qat-q4_0-gguf	medium	[GPQA][]	gemma-3-12b-pt	google	389	google/gemma-3-12b-pt	15
gemma-3-270m-it-GGUF	medium	[GPQA][]	gemma-3-270m	Mungert	390	google/gemma-3-270m	15
gemma-3-4b-it-qat	medium	[GPQA][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	391	google/gemma-3-4b-it-qat-q4_0-unquantized	15
gemma-3-270m-it-torchao-FP8	medium	[GPQA][]	gemma-3-270m-it	unsloth	392	google/gemma-3-270m-it	15
gemma-3-1b-it-qat-q4_0-unquantized	medium	[GPQA][]	gemma-3-1b-pt	google	393	google/gemma-3-1b-it	15
gemma-3-1b-it-qat	medium	[GPQA][]	gemma-3-1b-it-qat-q4-0-unquantized	unsloth	394	google/gemma-3-1b-it-qat-q4_0-unquantized	15
gemma-3-27b-it-qat	medium	[GPQA][]	gemma-3-27b-it-qat-q4-0-unquantized	unsloth	395	google/gemma-3-27b-it-qat-q4_0-unquantized	15
gemma-3-4b-pt-qat-q4_0-gguf	medium	[GPQA][]	gemma-3-4b-pt	google	396	google/gemma-3-4b-pt	15
Hermes-3-Llama-3.1-70B-lorablated	medium	GPQA (0-shot)	hermes-3-llama-3-1-70b	mlabonne	397	NousResearch/Hermes-3-Llama-3.1-70B	13.2
Falcon3-10B-Base	medium	GPQA (0-shot)	falcon3-10b-base	tiiuae	398	tiiuae/Falcon3-10B-Base	12.75
Llama-3.1-Tulu-3-70B-SFT	medium	GPQA (0-shot)	llama-3-1-70b	allenai	399	meta-llama/Llama-3.1-70B	12.64
Falcon3-10B-Instruct	medium	GPQA (0-shot)	falcon3-10b-base	tiiuae	400	tiiuae/Falcon3-10B-Base	10.51
t5gemma-2-270m-270m	medium	[GPQA]	t5gemma-2-270m-270m	google	401	google/t5gemma-2-270m-270m	9.6
t5gemma-2-4b-4b	medium	[GPQA]	t5gemma-2-4b-4b	google	402	google/t5gemma-2-4b-4b	9.6
t5gemma-2-1b-1b	medium	[GPQA]	t5gemma-2-1b-1b	google	403	google/t5gemma-2-1b-1b	9.6
Falcon-E-3B-Base	high	Unknown	falcon-e-3b-base	tiiuae	404	tiiuae/Falcon-E-3B-Base	8.67
Falcon-E-3B-Base-prequantized	high	Unknown	falcon-e-3b-base-prequantized	tiiuae	405	tiiuae/Falcon-E-3B-Base-prequantized	8.67
falcon-mamba-7b	low	Unknown	falcon-mamba-7b	tiiuae	406	tiiuae/falcon-mamba-7b	8.05
falcon-mamba-7b	medium	GPQA (0-shot)	falcon-mamba-7b	tiiuae	407	tiiuae/falcon-mamba-7b	8.05
falcon-mamba-7b-instruct	low	Unknown	falcon-mamba-7b	tiiuae	408	tiiuae/falcon-mamba-7b	8.05
falcon-mamba-7b-instruct-Q4_K_M-GGUF	low	Unknown	falcon-mamba-7b-instruct	tiiuae	409	tiiuae/falcon-mamba-7b-instruct	8.05
falcon-mamba-7b-instruct-4bit	low	Unknown	falcon-mamba-7b-instruct	tiiuae	410	tiiuae/falcon-mamba-7b-instruct	8.05
falcon-mamba-7b-Q8_0-GGUF	low	Unknown	falcon-mamba-7b	tiiuae	411	tiiuae/falcon-mamba-7b	8.05
falcon-mamba-7b-Q8_0-GGUF	medium	GPQA (0-shot)	falcon-mamba-7b	tiiuae	412	tiiuae/falcon-mamba-7b	8.05
falcon-mamba-7b-F16-GGUF	low	Unknown	falcon-mamba-7b	tiiuae	413	tiiuae/falcon-mamba-7b	8.05
falcon-mamba-7b-F16-GGUF	medium	GPQA (0-shot)	falcon-mamba-7b	tiiuae	414	tiiuae/falcon-mamba-7b	8.05
falcon-mamba-7b-4bit	low	Unknown	falcon-mamba-7b	tiiuae	415	tiiuae/falcon-mamba-7b	8.05
Llama-3.1-Tulu-3-8B	medium	GPQA (0-shot)	llama-3-1-tulu-3-8b-dpo	allenai	416	allenai/Llama-3.1-Tulu-3-8B-DPO	6.26
ChimeraLlama-3-8B-v3	medium	GPQA (0-shot)	meta-llama-3-8b-instruct	mlabonne	417	NousResearch/Meta-Llama-3-8B-Instruct	5.59
ChimeraLlama-3-8B-v2	medium	GPQA (0-shot)	meta-llama-3-8b-instruct	mlabonne	418	NousResearch/Meta-Llama-3-8B-Instruct	4.7
Llama-3.1-8B-ArliAI-RPMax-v1.1	medium	GPQA (0-shot)	llama-3-1-8b-arliai-rpmax-v1-1	ArliAI	419	ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.1	4.47
Mistral-Nemo-12B-ArliAI-RPMax-v1.1	medium	GPQA (0-shot)	mistral-nemo-12b-arliai-rpmax-v1-1	ArliAI	420	ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1	4.25
Falcon-E-1B-Base	high	Unknown	falcon-e-1b-base	tiiuae	421	tiiuae/Falcon-E-1B-Base	2.8

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/gpqa.html
url: huggingface.co/spaces/gpqa ↗