Leaderboard

PIQA

piqa

Record

Category: knowledge
Scored models: 201

Scores

Model	Score
allenai/Olmo-3-1125-32B	93.3
microsoft/GRIN-MoE	89
microsoft/Phi-3-small-128k-instruct	88.1
microsoft/Phi-3-medium-4k-instruct	87.9
microsoft/Phi-3-medium-128k-instruct	87.8
microsoft/Phi-3-small-8k-instruct	86.9
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	85.47
jondurbin/bagel-dpo-7b-v0.1	84
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	83.79
NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	83.24
NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	83.24
NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	83.24
NousResearch/Nous-Hermes-Llama2-70b	83.13
mlabonne/Beyonder-4x7B-v2	83.08
mlabonne/Marcoro14-7B-slerp	83.08
fblgit/UNAversal-8x7B-v1beta	82.92
AIDC-ai-business/Marcoroni-7B-v3	82.59
nvidia/NVIDIA-Nemotron-Nano-9B-v2-Base	82.54
nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	82.54
fblgit/juanako-7b-UNA	82.54
NousResearch/Nous-Hermes-2-Yi-34B	82.15
NousResearch/Nous-Hermes-2-Yi-34B	82.15
macadeliccc/laser-dolphin-mixtral-2x7b-dpo	82.1
openaccess-ai-collective/DPOpenHermes-7B	81.99

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: knowledge
id: piqa
name: PIQA
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
Olmo-3-1125-32B	low	PIQA MC	olmo-3-1125-32b	allenai	1	allenai/Olmo-3-1125-32B	93.3
GRIN-MoE	medium	PIQA	grin-moe	microsoft	2	microsoft/GRIN-MoE	89
Phi-3-small-128k-instruct	medium	PIQA<br>5-shot	phi-3-small-128k-instruct	microsoft	3	microsoft/Phi-3-small-128k-instruct	88.1
Phi-3-medium-4k-instruct	medium	PIQA<br>5-shot	phi-3-medium-4k-instruct	microsoft	4	microsoft/Phi-3-medium-4k-instruct	87.9
Phi-3-medium-128k-instruct	medium	PIQA<br>5-shot	phi-3-medium-128k-instruct	microsoft	5	microsoft/Phi-3-medium-128k-instruct	87.8
Phi-3-small-8k-instruct	medium	PIQA<br>5-shot	phi-3-small-8k-instruct	microsoft	6	microsoft/Phi-3-small-8k-instruct	86.9
NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	medium	PIQA	nvidia-nemotron-3-super-120b-a12b-base-bf16	nvidia	7	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	85.47
bagel-dpo-7B-v0.1-GGUF	low	piqa	bagel-dpo-7b-v0-1	TheBloke	8	jondurbin/bagel-dpo-7b-v0.1	84
NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	medium	PIQA	nvidia-nemotron-3-ultra-550b-a55b-base-bf16	nvidia	9	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	83.79
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	piqa	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	10	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	83.24
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	piqa	nous-hermes-2-mixtral-8x7b-sft	TheBloke	11	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	83.24
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	piqa	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	12	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	83.24
Nous-Hermes-Llama2-70B-GGUF	medium	piqa	Unknown	TheBloke	13	NousResearch/Nous-Hermes-Llama2-70b	83.13
Beyonder-4x7B-v2-GGUF	medium	piqa	beyonder-4x7b-v2	TheBloke	14	mlabonne/Beyonder-4x7B-v2	83.08
Beyonder-4x7B-v2	medium	piqa	marcoro14-7b-slerp	mlabonne	15	mlabonne/Marcoro14-7B-slerp	83.08
UNAversal-8x7B-v1beta-GGUF	medium	piqa	unaversal-8x7b-v1beta	TheBloke	16	fblgit/UNAversal-8x7B-v1beta	82.92
Marcoro14-7B-slerp	medium	piqa	marcoro14-7b-slerp	mlabonne	17	AIDC-ai-business/Marcoroni-7B-v3	82.59
NVIDIA-Nemotron-Nano-9B-v2-Base	medium	PIQA	nvidia-nemotron-nano-9b-v2-base	nvidia	18	nvidia/NVIDIA-Nemotron-Nano-9B-v2-Base	82.54
NVIDIA-Nemotron-Nano-12B-v2-Base	medium	PIQA	nvidia-nemotron-nano-12b-v2-base	nvidia	19	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	82.54
juanako-7B-UNA-GGUF	medium	piqa	juanako-7b-una	TheBloke	20	fblgit/juanako-7b-UNA	82.54
Nous-Hermes-2-Yi-34B-GGUF	medium	piqa	nous-hermes-2-yi-34b	TheBloke	21	NousResearch/Nous-Hermes-2-Yi-34B	82.15
Nous-Hermes-2-Yi-34B-AWQ	medium	piqa	nous-hermes-2-yi-34b	TheBloke	22	NousResearch/Nous-Hermes-2-Yi-34B	82.15
laser-dolphin-mixtral-2x7b-dpo-GGUF	medium	piqa	laser-dolphin-mixtral-2x7b-dpo	TheBloke	23	macadeliccc/laser-dolphin-mixtral-2x7b-dpo	82.1
DPOpenHermes-7B-GGUF	medium	piqa	dpopenhermes-7b	TheBloke	24	openaccess-ai-collective/DPOpenHermes-7B	81.99
NeuralHermes-2.5-Mistral-7B-laser	medium	piqa	openhermes-2-5-mistral-7b	mlabonne	25	teknium/OpenHermes-2.5-Mistral-7B	81.94
juanako-7B-v1-GGUF	medium	piqa	juanako-7b-v1	TheBloke	26	fblgit/juanako-7b-v1	81.94
gemma-2-9b-it	medium	[PIQA][]	gemma-2-9b	google	27	google/gemma-2-9b	81.7
gemma-2-27b-it	medium	[PIQA][]	gemma-2-27b	google	28	google/gemma-2-27b	81.7
gemma-2-9b	medium	[PIQA][]	gemma-2-9b	google	29	google/gemma-2-9b	81.7
gemma-2-27b	medium	[PIQA][]	gemma-2-27b	google	30	google/gemma-2-27b	81.7
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	piqa	nous-hermes-2-solar-10-7b	TheBloke	31	NousResearch/Nous-Hermes-2-SOLAR-10.7B	81.61
OpenHermes-2.5-Mistral-7B-AWQ	medium	piqa	openhermes-2-5-mistral-7b	TheBloke	32	teknium/OpenHermes-2.5-Mistral-7B	81.45
OpenHermes-2.5-Mistral-7B-GGUF	medium	piqa	openhermes-2-5-mistral-7b	TheBloke	33	teknium/OpenHermes-2.5-Mistral-7B	81.45
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	piqa	Unknown	TheBloke	34	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	81.45
OpenHermes-2.5-Mistral-7B-GPTQ	medium	piqa	openhermes-2-5-mistral-7b	TheBloke	35	teknium/OpenHermes-2.5-Mistral-7B	81.45
Mistral-11B-OmniMix-GGUF	medium	piqa	mistral-11b-omnimix-bf16	TheBloke	36	NeverSleep/Mistral-11B-OmniMix-bf16	81.45
NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16	medium	PIQA (0-shot, acc_norm)	nvidia-nemotron-3-nano-30b-a3b-base-bf16	nvidia	37	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16	81.01
OpenHermes-2-Mistral-7B-GGUF	medium	piqa	mistral-7b-v0-1	TheBloke	38	teknium/OpenHermes-2-Mistral-7B	80.9
OpenHermes-2-Mistral-7B-AWQ	medium	piqa	mistral-7b-v0-1	TheBloke	39	teknium/OpenHermes-2-Mistral-7B	80.9
CollectiveCognition-v1-Mistral-7B-GGUF	medium	piqa	mistral-7b-v0-1	TheBloke	40	teknium/CollectiveCognition-v1-Mistral-7B	80.85
minotaur-13B-fixed-GGUF	medium	piqa	Unknown	TheBloke	41	openaccess-ai-collective/minotaur-13b-fixed	80.25
CollectiveCognition-v1.1-Mistral-7B-GGUF	medium	piqa	mistral-7b-v0-1	TheBloke	42	teknium/CollectiveCognition-v1.1-Mistral-7B	79.92
OLMoE-1B-7B-0924	low	Open Data	olmoe-1b-7b-0924	allenai	43	allenai/OLMoE-1B-7B-0924	79.8
Apertus-8B-Instruct-2509-GGUF	low	PIQA	apertus-8b-instruct-2509	unsloth	44	swiss-ai/Apertus-8B-Instruct-2509	79.8
Apertus-70B-Instruct-2509-GGUF	low	PIQA	apertus-70b-instruct-2509	unsloth	45	swiss-ai/Apertus-70B-Instruct-2509	79.8
Apertus-8B-Instruct-2509-unsloth-bnb-4bit	low	PIQA	apertus-8b-2509	unsloth	46	swiss-ai/Apertus-8B-2509	79.8
Nous-Hermes-13B-GGUF	medium	piqa	Unknown	TheBloke	47	NousResearch/Nous-Hermes-13b	79.65
Nous-Hermes-13B-SuperHOT-8K-fp16	medium	piqa	Unknown	TheBloke	48	—	79.65
Nous-Hermes-13B-SuperHOT-8K-GPTQ	medium	piqa	Unknown	TheBloke	49	—	79.65
Redmond-Puffin-13B-GGUF	medium	piqa	Unknown	TheBloke	50	NousResearch/Redmond-Puffin-13B	79.54
Redmond-Puffin-13B-GPTQ	medium	piqa	Unknown	TheBloke	51	NousResearch/Redmond-Puffin-13B	79.54
Tulpar-7B-v0-GGUF	medium	piqa	Unknown	TheBloke	52	HyperbeeAI/Tulpar-7b-v0	79.05
gemma-3n-E2B-it	medium	[PIQA][]	gemma-3n-e4b	google	53	google/gemma-3n-E4B-it	78.9
gemma-3n-E4B-it	medium	[PIQA][]	gemma-3n-e4b	google	54	google/gemma-3n-E4B	78.9
gemma-3n-E4B-it-litert-lm	medium	[PIQA][]	gemma-3n-e4b	google	55	google/gemma-3n-E4B-it-litert-lm	78.9
gemma-3n-E2B-it-GGUF	medium	[PIQA][]	gemma-3n-e2b-it	unsloth	56	google/gemma-3n-E2B-it	78.9
gemma-3n-E4B-it	medium	[PIQA][]	gemma-3n-e4b	unsloth	57	google/gemma-3n-E4B-it	78.9
gemma-3n-E2B	medium	[PIQA][]	gemma-3n-e4b	google	58	google/gemma-3n-E4B	78.9
gemma-3n-E2B-it-litert-lm	medium	[PIQA][]	gemma-3n-e2b-it	google	59	google/gemma-3n-E2B-it-litert-lm	78.9
gemma-3n-E4B-it-GGUF	medium	[PIQA][]	gemma-3n-e4b	unsloth	60	google/gemma-3n-E4B-it	78.9
gemma-3n-E4B	medium	[PIQA][]	gemma-3n-e4b	google	61	google/gemma-3n-E4B	78.9
gemma-3n-E2B-it-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3n-e2b-it	unsloth	62	google/gemma-3n-E2B-it	78.9
gemma-3n-E2B-it-litert-preview-GGUF	medium	[PIQA][]	gemma-3n-e2b-it	unsloth	63	google/gemma-3n-E2B-it-litert-preview	78.9
gemma-3n-E4B-it-litert-preview-GGUF	medium	[PIQA][]	gemma-3n-e4b	unsloth	64	google/gemma-3n-E4B-it-litert-preview	78.9
gemma-3n-E4B-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3n-e4b	unsloth	65	google/gemma-3n-E4B-it	78.9
gemma-3n-E2B-it-ONNX	medium	[PIQA][]	gemma-3n-e2b-it	onnx-community	66	google/gemma-3n-E2B-it	78.9
gemma-3n-E4B-it-GGUF	medium	[PIQA][]	gemma-3n-e4b	Mungert	67	google/gemma-3n-E4B	78.9
gemma-3n-E4B-it-absolute-heresy-MPOA-imatrix-GGUF	medium	[PIQA][]	gemma-3n-e4b-it-absolute-heresy-mpoa	MuXodious	68	MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA	78.9
gemma-3n-E4B-it-absolute-heresy-GGUF	medium	[PIQA][]	gemma-3n-e4b	MuXodious	69	google/gemma-3n-E4B-it	78.9
gemma-3n-E4B-it-absolute-heresy-MPOA-GGUF	medium	[PIQA][]	gemma-3n-e4b-it-absolute-heresy-mpoa	MuXodious	70	MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA	78.9
gemma-3n-E2B-it-GGUF	medium	[PIQA][]	gemma-3n-e4b	Mungert	71	google/gemma-3n-E4b-it	78.9
OLMoE-1B-7B-0125	low	Open Data	olmoe-1b-7b-0125	allenai	72	allenai/OLMoE-1B-7B-0125	78.7
gemma-2-2b-it	medium	[PIQA][]	gemma-2-2b	google	73	google/gemma-2-2b	77.8
gemma-2-2b	medium	[PIQA][]	gemma-2-2b	google	74	google/gemma-2-2b	77.8
Phi-4-mini-instruct	medium	PIQA (5-shot)	phi-4-mini-instruct	microsoft	75	microsoft/Phi-4-mini-instruct	77.6
Phi-4-mini-instruct-GGUF	medium	PIQA (5-shot)	phi-4-mini-instruct	unsloth	76	microsoft/Phi-4-mini-instruct	77.6
Phi-4-mini-instruct-unsloth-bnb-4bit	medium	PIQA (5-shot)	phi-4-mini-instruct	unsloth	77	microsoft/Phi-4-mini-instruct	77.6
Phi-4-mini-instruct-bnb-4bit	medium	PIQA (5-shot)	phi-4-mini-instruct	unsloth	78	microsoft/Phi-4-mini-instruct	77.6
Phi-4-mini-instruct	medium	PIQA (5-shot)	phi-4-mini-instruct	unsloth	79	microsoft/Phi-4-mini-instruct	77.6
Phi-4-mini-instruct-GGUF	medium	PIQA (5-shot)	phi-4-mini-instruct	Mungert	80	microsoft/Phi-4-mini-instruct	77.6
SmolLM2-1.7B-Instruct-GGUF	medium	PIQA	smollm2-1-7b	Mungert	81	HuggingFaceTB/SmolLM2-1.7B	77.6
gemma-1.1-2b-it	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-1-1-2b-it	google	82	google/gemma-1.1-2b-it	77.3
gemma-2b	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-2b-it	google	83	google/gemma-2b-it-pytorch	77.3
gemma-2b-it	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-2b-it	google	84	google/gemma-2b-it-pytorch	77.3
gemma-7b	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-7b-it	google	85	google/gemma-7b-it-quant-pytorch	77.3
gemma-7b-it	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-7b	google	86	google/gemma-7b	77.3
gemma-1.1-7b-it	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-1-1-7b-it	google	87	google/gemma-1.1-7b-it	77.3
gemma-2b-AWQ	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-2b-it	google	88	google/gemma-2b-it-pytorch	77.3
gemma-7b	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-7b-it	alpindale	89	google/gemma-7b-it-quant-pytorch	77.3
gemma-2b	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-2b-it	alpindale	90	google/gemma-2b-it-pytorch	77.3
gemma-7b-AWQ	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-7b-it	google	91	google/gemma-7b-it-quant-pytorch	77.3
gemma-7b-it	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-7b-it	alpindale	92	google/gemma-7b-it-quant-pytorch	77.3
gemma-7b-GGUF	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-7b-it	google	93	google/gemma-7b-it-quant-pytorch	77.3
OLMo-1B-0724-hf	medium	piqa	olmo-1b-0724-hf	allenai	94	allenai/OLMo-1B-0724-hf	77.2
OLMo-7B-0424-hf	medium	piqa	olmo-7b-0424-hf	allenai	95	allenai/OLMo-7B-0424-hf	77.2
OLMo-7B-0724-hf	medium	piqa	olmo-7b-0724-hf	allenai	96	allenai/OLMo-7B-0724-hf	77.2
OLMo-7B-0424	medium	piqa	Unknown	allenai	97	allenai/OLMo-7B-0424	77.2
Llama2-7b-WhoIsHarryPotter	low	PIQA	Unknown	microsoft	98	microsoft/Llama2-7b-WhoIsHarryPotter	76.7
MobileLLM-Pro-base	medium	PIQA	mobilellm-pro-base	facebook	99	facebook/MobileLLM-Pro-base	76.55
MobileLLM-Pro	medium	PIQA	mobilellm-pro-base	facebook	100	facebook/MobileLLM-Pro-base	76.55
OLMo-1B-hf	medium	piqa	olmo-1b-hf	allenai	101	allenai/OLMo-1B-hf	76.3
OLMo-7B	medium	piqa	olmo-7b	allenai	102	allenai/OLMo-7B	76.3
OLMo-7B-hf	medium	piqa	olmo-7b-hf	allenai	103	allenai/OLMo-7B-hf	76.3
OLMo-1B	medium	piqa	olmo-1b	allenai	104	allenai/OLMo-1B	76.3
OLMo-7B-Twin-2T-hf	medium	piqa	olmo-7b-twin-2t-hf	allenai	105	allenai/OLMo-7B-Twin-2T-hf	76.3
OLMo-7B-Twin-2T	medium	piqa	olmo-7b-twin-2t	allenai	106	allenai/OLMo-7B-Twin-2T	76.3
nemo-megatron-gpt-5B	low	PiQA	Unknown	nvidia	107	nvidia/nemo-megatron-gpt-5B	74.92
bitnet-b1.58-2B-4T-gguf	medium	PIQA	bitnet-b1-58-2b-4t-bf16	microsoft	108	microsoft/bitnet-b1.58-2B-4T-bf16	74.21
bitnet-b1.58-2B-4T	medium	PIQA	bitnet-b1-58-2b-4t	microsoft	109	microsoft/bitnet-b1.58-2B-4T	74.21
bitnet-b1.58-2B-4T-bf16	medium	PIQA	bitnet-b1-58-2b-4t-bf16	microsoft	110	microsoft/bitnet-b1.58-2B-4T-bf16	74.21
gemma-3-1b-it	medium	[PIQA][]	gemma-3-1b-it	google	111	google/gemma-3-1b-pt	73.8
gemma-3-4b-it	medium	[PIQA][]	gemma-3-4b-it	google	112	google/gemma-3-4b-pt	73.8
gemma-3-12b-it	medium	[PIQA][]	gemma-3-12b-pt	google	113	google/gemma-3-12b-pt	73.8
gemma-3-27b-it	medium	[PIQA][]	gemma-3-27b-pt	google	114	google/gemma-3-27b-pt	73.8
gemma-3-4b-it	medium	[PIQA][]	gemma-3-4b-it	unsloth	115	google/gemma-3-4b-it	73.8
gemma-3-1b-it-GGUF	medium	[PIQA][]	gemma-3-1b-it	ggml-org	116	google/gemma-3-1b-it	73.8
gemma-3-12b-it-qat-q4_0-unquantized	medium	[PIQA][]	gemma-3-12b-it	google	117	google/gemma-3-12b-it	73.8
gemma-3-1b-it	medium	[PIQA][]	gemma-3-1b-it	unsloth	118	google/gemma-3-1b-it	73.8
gemma-3-12b-it-GGUF	medium	[PIQA][]	gemma-3-12b-it	unsloth	119	google/gemma-3-12b-it	73.8
gemma-3-4b-pt	medium	[PIQA][]	gemma-3-4b-pt	google	120	google/gemma-3-4b-pt	73.8
gemma-3-12b-it-qat-GGUF	medium	[PIQA][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	121	google/gemma-3-12b-it-qat-q4_0-unquantized	73.8
gemma-3-27b-it	medium	[PIQA][]	gemma-3-27b-it	unsloth	122	google/gemma-3-27b-it	73.8
gemma-3-1b-pt	medium	[PIQA][]	gemma-3-1b-pt	google	123	google/gemma-3-1b-pt	73.8
gemma-3-4b-it-GGUF	medium	[PIQA][]	gemma-3-4b-it	ggml-org	124	google/gemma-3-4b-it	73.8
gemma-3-4b-it-GGUF	medium	[PIQA][]	gemma-3-4b-it	unsloth	125	google/gemma-3-4b-it	73.8
gemma-3-1b-it-GGUF	medium	[PIQA][]	gemma-3-1b-it	unsloth	126	google/gemma-3-1b-it	73.8
gemma-3-12b-pt	medium	[PIQA][]	gemma-3-12b-pt	google	127	google/gemma-3-12b	73.8
gemma-3-12b-it-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-12b-it	unsloth	128	google/gemma-3-12b-it	73.8
gemma-3-4b-it-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-4b-it	unsloth	129	google/gemma-3-4b-it	73.8
gemma-3-12b-it	medium	[PIQA][]	gemma-3-12b-pt	unsloth	130	google/gemma-3-12b-pt	73.8
gemma-3-27b-it-GGUF	medium	[PIQA][]	gemma-3-27b-it	unsloth	131	google/gemma-3-27b-it	73.8
gemma-3-1b-it-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-1b-it	unsloth	132	google/gemma-3-1b-it	73.8
gemma-3-4b-it-bnb-4bit	medium	[PIQA][]	gemma-3-4b-it	unsloth	133	google/gemma-3-4b-it	73.8
gemma-3-4b-pt	medium	[PIQA][]	gemma-3-4b-pt	unsloth	134	google/gemma-3-4b-pt	73.8
gemma-3-27b-pt	medium	[PIQA][]	gemma-3-27b-pt	google	135	google/gemma-3-27b-pt	73.8
gemma-3-12b-it-bnb-4bit	medium	[PIQA][]	gemma-3-12b-it	unsloth	136	google/gemma-3-12b-it	73.8
gemma-3-27b-it-GGUF	medium	[PIQA][]	gemma-3-27b-it	ggml-org	137	google/gemma-3-27b-it	73.8
gemma-3-12b-pt	medium	[PIQA][]	gemma-3-12b-pt	unsloth	138	google/gemma-3-12b-pt	73.8
gemma-3-27b-it-bnb-4bit	medium	[PIQA][]	gemma-3-27b-it	unsloth	139	google/gemma-3-27b-it	73.8
gemma-3-27b-it-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-27b-it	unsloth	140	google/gemma-3-27b-it	73.8
gemma-3-1b-pt	medium	[PIQA][]	gemma-3-1b-pt	unsloth	141	google/gemma-3-1b-pt	73.8
gemma-3-12b-it-GGUF	medium	[PIQA][]	gemma-3-12b-it	ggml-org	142	google/gemma-3-12b-it	73.8
gemma-3-4b-it-qat-GGUF	medium	[PIQA][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	143	google/gemma-3-4b-it-qat-q4_0-unquantized	73.8
gemma-3-12b-it-qat-bnb-4bit	medium	[PIQA][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	144	google/gemma-3-12b-it-qat-q4_0-unquantized	73.8
gemma-3-12b-it-qat-int4-GGUF	medium	[PIQA][]	gemma-3-12b-it-qat-int4-unquantized	unsloth	145	google/gemma-3-12b-it-qat-int4-unquantized	73.8
gemma-3-4b-it-qat-q4_0-gguf	medium	[PIQA][]	gemma-3-4b-it	google	146	google/gemma-3-4b-it	73.8
gemma-3-4b-it-qat-q4_0-unquantized	medium	[PIQA][]	gemma-3-4b-it	google	147	google/gemma-3-4b-it	73.8
gemma-3-4b-pt-bnb-4bit	medium	[PIQA][]	gemma-3-4b-pt	unsloth	148	google/gemma-3-4b-pt	73.8
gemma-3-27b-it-qat-GGUF	medium	[PIQA][]	gemma-3-27b-it-qat-q4-0-unquantized	unsloth	149	google/gemma-3-27b-it-qat-q4_0-unquantized	73.8
gemma-3-12b-it-qat-q4_0-gguf	medium	[PIQA][]	gemma-3-12b-it	google	150	google/gemma-3-12b-it	73.8
gemma-3-1b-it-bnb-4bit	medium	[PIQA][]	gemma-3-1b-it	unsloth	151	google/gemma-3-1b-it	73.8
gemma-3-1b-it-qat-q4_0-gguf	medium	[PIQA][]	gemma-3-1b-it	google	152	google/gemma-3-1b-it	73.8
gemma-3-4b-pt-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-4b-pt	unsloth	153	google/gemma-3-4b-pt	73.8
gemma-3-12b-it-qat	medium	[PIQA][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	154	google/gemma-3-12b-it-qat-q4_0-unquantized	73.8
gemma-3-1b-pt-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-1b-pt	unsloth	155	google/gemma-3-1b-pt	73.8
gemma-3-4b-it-FP8-Dynamic	medium	[PIQA][]	gemma-3-4b-it	unsloth	156	google/gemma-3-4b-it	73.8
gemma-3-12b-pt-bnb-4bit	medium	[PIQA][]	gemma-3-12b-pt	unsloth	157	google/gemma-3-12b-pt	73.8
gemma-3-12b-it-qat-int4-unquantized	medium	[PIQA][]	gemma-3-12b-it	google	158	google/gemma-3-12b-it	73.8
gemma-3-27b-it-GGUF	medium	[PIQA][]	gemma-3-27b-pt	Mungert	159	google/gemma-3-27b-pt	73.8
gemma-3-27b-it-qat-q4_0-unquantized	medium	[PIQA][]	gemma-3-27b-it	google	160	google/gemma-3-27b-it	73.8
gemma-3-12b-pt-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-12b-pt	unsloth	161	google/gemma-3-12b-pt	73.8
gemma-3-27b-it-qat-q4_0-gguf	medium	[PIQA][]	gemma-3-27b-it	google	162	google/gemma-3-27b-it	73.8
gemma-3-27b-it-qat-q4_0-GGUF	medium	[PIQA][]	gemma-3-27b-it	Mungert	163	google/gemma-3-27b-it	73.8
gemma-3-4b-it-qat-bnb-4bit	medium	[PIQA][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	164	google/gemma-3-4b-it-qat-q4_0-unquantized	73.8
gemma-3-1b-pt-bnb-4bit	medium	[PIQA][]	gemma-3-1b-pt	unsloth	165	google/gemma-3-1b-pt	73.8
gemma-3-27b-pt	medium	[PIQA][]	gemma-3-27b-pt	unsloth	166	google/gemma-3-27b-pt	73.8
gemma-3-12b-it-FP8-Dynamic	medium	[PIQA][]	gemma-3-12b-pt	unsloth	167	google/gemma-3-12b-pt	73.8
gemma-3-1b-it-qat-int4-unquantized	medium	[PIQA][]	gemma-3-1b-it	google	168	google/gemma-3-1b-it	73.8
gemma-3-27b-pt-bnb-4bit	medium	[PIQA][]	gemma-3-27b-pt	unsloth	169	google/gemma-3-27b-pt	73.8
gemma-3-12b-it-qat-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	170	google/gemma-3-12b-it-qat-q4_0-unquantized	73.8
gemma-3-12b-pt-qat-q4_0-gguf	medium	[PIQA][]	gemma-3-12b-pt	google	171	google/gemma-3-12b-pt	73.8
gemma-3-4b-it-qat	medium	[PIQA][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	172	google/gemma-3-4b-it-qat-q4_0-unquantized	73.8
gemma-3-1b-it-qat-q4_0-unquantized	medium	[PIQA][]	gemma-3-1b-it	google	173	google/gemma-3-1b-it	73.8
gemma-3-1b-it-qat	medium	[PIQA][]	gemma-3-1b-it-qat-q4-0-unquantized	unsloth	174	google/gemma-3-1b-it-qat-q4_0-unquantized	73.8
gemma-3-27b-it-qat	medium	[PIQA][]	gemma-3-27b-it-qat-q4-0-unquantized	unsloth	175	google/gemma-3-27b-it-qat-q4_0-unquantized	73.8
gemma-3-4b-pt-qat-q4_0-gguf	medium	[PIQA][]	gemma-3-4b-pt	google	176	google/gemma-3-4b-pt	73.8
TinyLlama-1.1B-intermediate-step-1431k-3T-GGUF	high	piqa	tinyllama-1-1b-intermediate-step-1431k-3t	TheBloke	177	TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T	73.29
SmolLM2-360M-Instruct-GGUF	medium	PIQA	smollm2-360m	Mungert	178	HuggingFaceTB/SmolLM2-360M	71.7
TinyLlama-1.1B-intermediate-step-715k-1.5T-GGUF	high	piqa	tinyllama-1-1b-intermediate-step-715k-1-5t	TheBloke	179	PY007/TinyLlama-1.1B-intermediate-step-715k-1.5T	71.65
SmolLM2-135M-Instruct-GGUF	medium	PIQA	smollm2-135m	Mungert	180	HuggingFaceTB/SmolLM2-135M	68.4
vaultgemma-1b	medium	[PIQA][]	vaultgemma-1b	google	181	google/vaultgemma-1b	68
gemma-3-270m	medium	[PIQA][]	gemma-3-270m	google	182	google/gemma-3-270m	67.7
gemma-3-270m-it	medium	[PIQA][]	gemma-3-270m	google	183	google/gemma-3-270m	67.7
gemma-3-270m-it-GGUF	medium	[PIQA][]	gemma-3-270m-it	unsloth	184	google/gemma-3-270m-it	67.7
gemma-3-270m-it	medium	[PIQA][]	gemma-3-270m-it	unsloth	185	google/gemma-3-270m-it	67.7
gemma-3-270m-it-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-270m-it	unsloth	186	google/gemma-3-270m-it	67.7
gemma-3-270m-it-qat-GGUF	medium	[PIQA][]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	187	google/gemma-3-270m-it-qat-q4_0-unquantized	67.7
gemma-3-270m	medium	[PIQA][]	gemma-3-270m	unsloth	188	google/gemma-3-270m	67.7
gemma-3-270m-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-270m-it	unsloth	189	google/gemma-3-270m-it	67.7
gemma-3-270m-it-qat-q4_0-unquantized	medium	[PIQA][]	gemma-3-270m-it	google	190	google/gemma-3-270m-it	67.7
gemma-3-270m-it-bnb-4bit	medium	[PIQA][]	gemma-3-270m-it	unsloth	191	google/gemma-3-270m-it	67.7
gemma-3-270m-it-qat	medium	[PIQA][]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	192	google/gemma-3-270m-it-qat-q4_0-unquantized	67.7
gemma-3-270m-bnb-4bit	medium	[PIQA][]	gemma-3-270m	unsloth	193	google/gemma-3-270m	67.7
gemma-3-270m-qat-q4_0-unquantized	medium	[PIQA][]	gemma-3-270m	google	194	google/gemma-3-270m	67.7
gemma-3-270m-it-GGUF	medium	[PIQA][]	gemma-3-270m	Mungert	195	google/gemma-3-270m	67.7
gemma-3-270m-it-torchao-FP8	medium	[PIQA][]	gemma-3-270m-it	unsloth	196	google/gemma-3-270m-it	67.7
t5gemma-2-270m-270m	medium	[PIQA]	t5gemma-2-270m-270m	google	197	google/t5gemma-2-270m-270m	66.5
t5gemma-2-4b-4b	medium	[PIQA]	t5gemma-2-4b-4b	google	198	google/t5gemma-2-4b-4b	66.5
t5gemma-2-1b-1b	medium	[PIQA]	t5gemma-2-1b-1b	google	199	google/t5gemma-2-1b-1b	66.5
Redmond-Hermes-Coder-GPTQ	medium	piqa	Unknown	TheBloke	200	—	66
MobileLLM-125M	low	piqa	Unknown	facebook	201	facebook/MobileLLM-125M	62

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/piqa.html, docs/notes/hf-benchmark-contexts.json
url: huggingface.co/spaces/piqa ↗