Leaderboard

PIQA

piqa

Record

Category: knowledge
Scored models: 204

Scores

Model	Score
allenai/Olmo-3-1125-32B	93.3
microsoft/GRIN-MoE	89
microsoft/Phi-3-small-128k-instruct	88.1
microsoft/Phi-3-medium-4k-instruct	87.9
microsoft/Phi-3-medium-128k-instruct	87.8
microsoft/Phi-3-small-8k-instruct	86.9
allenai/Olmo-3-1025-7B	85.7
allenai/Olmo-Hybrid-7B	85.7
allenai/Olmo-3-1025-7B	85.7
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	85.47
jondurbin/bagel-dpo-7b-v0.1	84
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	83.79
NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	83.24
NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	83.24
NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	83.24
NousResearch/Nous-Hermes-Llama2-70b	83.13
mlabonne/Beyonder-4x7B-v2	83.08
mlabonne/Marcoro14-7B-slerp	83.08
fblgit/UNAversal-8x7B-v1beta	82.92
AIDC-ai-business/Marcoroni-7B-v3	82.59
nvidia/NVIDIA-Nemotron-Nano-9B-v2-Base	82.54
nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	82.54
fblgit/juanako-7b-UNA	82.54
NousResearch/Nous-Hermes-2-Yi-34B	82.15

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: knowledge
id: piqa
name: PIQA
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
Olmo-3-1125-32B	low	Unknown	olmo-3-1125-32b	allenai	1	allenai/Olmo-3-1125-32B	93.3
GRIN-MoE	medium	PIQA	grin-moe	microsoft	2	microsoft/GRIN-MoE	89
Phi-3-small-128k-instruct	medium	PIQA<br>5-shot	phi-3-small-128k-instruct	microsoft	3	microsoft/Phi-3-small-128k-instruct	88.1
Phi-3-medium-4k-instruct	medium	PIQA<br>5-shot	phi-3-medium-4k-instruct	microsoft	4	microsoft/Phi-3-medium-4k-instruct	87.9
Phi-3-medium-128k-instruct	medium	PIQA<br>5-shot	phi-3-medium-128k-instruct	microsoft	5	microsoft/Phi-3-medium-128k-instruct	87.8
Phi-3-small-8k-instruct	medium	PIQA<br>5-shot	phi-3-small-8k-instruct	microsoft	6	microsoft/Phi-3-small-8k-instruct	86.9
Olmo-3-1025-7B	low	Unknown	olmo-3-1025-7b	allenai	7	allenai/Olmo-3-1025-7B	85.7
Olmo-Hybrid-7B	low	Unknown	olmo-hybrid-7b	allenai	8	allenai/Olmo-Hybrid-7B	85.7
Olmo-3-1025-7B-GGUF	low	Unknown	olmo-3-1025-7b	Mungert	9	allenai/Olmo-3-1025-7B	85.7
NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	medium	PIQA	nvidia-nemotron-3-super-120b-a12b-base-bf16	nvidia	10	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	85.47
bagel-dpo-7B-v0.1-GGUF	low	Unknown	bagel-dpo-7b-v0-1	TheBloke	11	jondurbin/bagel-dpo-7b-v0.1	84
NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	medium	PIQA	nvidia-nemotron-3-ultra-550b-a55b-base-bf16	nvidia	12	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	83.79
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	Unknown	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	13	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	83.24
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	Unknown	nous-hermes-2-mixtral-8x7b-sft	TheBloke	14	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	83.24
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	Unknown	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	15	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	83.24
Nous-Hermes-Llama2-70B-GGUF	medium	Unknown	Unknown	TheBloke	16	NousResearch/Nous-Hermes-Llama2-70b	83.13
Beyonder-4x7B-v2-GGUF	medium	Unknown	beyonder-4x7b-v2	TheBloke	17	mlabonne/Beyonder-4x7B-v2	83.08
Beyonder-4x7B-v2	medium	Unknown	marcoro14-7b-slerp	mlabonne	18	mlabonne/Marcoro14-7B-slerp	83.08
UNAversal-8x7B-v1beta-GGUF	medium	Unknown	unaversal-8x7b-v1beta	TheBloke	19	fblgit/UNAversal-8x7B-v1beta	82.92
Marcoro14-7B-slerp	medium	Unknown	Unknown	mlabonne	20	AIDC-ai-business/Marcoroni-7B-v3	82.59
NVIDIA-Nemotron-Nano-9B-v2-Base	medium	PIQA	nvidia-nemotron-nano-9b-v2-base	nvidia	21	nvidia/NVIDIA-Nemotron-Nano-9B-v2-Base	82.54
NVIDIA-Nemotron-Nano-12B-v2-Base	medium	PIQA	nvidia-nemotron-nano-12b-v2-base	nvidia	22	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	82.54
juanako-7B-UNA-GGUF	medium	Unknown	juanako-7b-una	TheBloke	23	fblgit/juanako-7b-UNA	82.54
Nous-Hermes-2-Yi-34B-GGUF	medium	Unknown	nous-hermes-2-yi-34b	TheBloke	24	NousResearch/Nous-Hermes-2-Yi-34B	82.15
Nous-Hermes-2-Yi-34B-AWQ	medium	Unknown	nous-hermes-2-yi-34b	TheBloke	25	NousResearch/Nous-Hermes-2-Yi-34B	82.15
laser-dolphin-mixtral-2x7b-dpo-GGUF	medium	Unknown	laser-dolphin-mixtral-2x7b-dpo	TheBloke	26	macadeliccc/laser-dolphin-mixtral-2x7b-dpo	82.1
DPOpenHermes-7B-GGUF	medium	Unknown	dpopenhermes-7b	TheBloke	27	openaccess-ai-collective/DPOpenHermes-7B	81.99
NeuralHermes-2.5-Mistral-7B-laser	medium	Unknown	openhermes-2-5-mistral-7b	mlabonne	28	teknium/OpenHermes-2.5-Mistral-7B	81.94
juanako-7B-v1-GGUF	medium	Unknown	juanako-7b-v1	TheBloke	29	fblgit/juanako-7b-v1	81.94
gemma-2-9b-it	medium	[PIQA][]	gemma-2-9b	google	30	google/gemma-2-9b	81.7
gemma-2-27b-it	medium	[PIQA][]	gemma-2-27b	google	31	google/gemma-2-27b	81.7
gemma-2-9b	medium	[PIQA][]	gemma-2-9b	google	32	google/gemma-2-9b	81.7
gemma-2-27b	medium	[PIQA][]	gemma-2-27b	google	33	google/gemma-2-27b	81.7
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	Unknown	nous-hermes-2-solar-10-7b	TheBloke	34	NousResearch/Nous-Hermes-2-SOLAR-10.7B	81.61
OpenHermes-2.5-Mistral-7B-AWQ	medium	Unknown	openhermes-2-5-mistral-7b	TheBloke	35	teknium/OpenHermes-2.5-Mistral-7B	81.45
OpenHermes-2.5-Mistral-7B-GGUF	medium	Unknown	openhermes-2-5-mistral-7b	TheBloke	36	teknium/OpenHermes-2.5-Mistral-7B	81.45
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	Unknown	Unknown	TheBloke	37	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	81.45
OpenHermes-2.5-Mistral-7B-GPTQ	medium	Unknown	openhermes-2-5-mistral-7b	TheBloke	38	teknium/OpenHermes-2.5-Mistral-7B	81.45
Mistral-11B-OmniMix-GGUF	medium	Unknown	mistral-11b-omnimix-bf16	TheBloke	39	NeverSleep/Mistral-11B-OmniMix-bf16	81.45
NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16	medium	PIQA (0-shot, acc_norm)	nvidia-nemotron-3-nano-30b-a3b-base-bf16	nvidia	40	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16	81.01
OpenHermes-2-Mistral-7B-GGUF	medium	Unknown	Unknown	TheBloke	41	teknium/OpenHermes-2-Mistral-7B	80.9
OpenHermes-2-Mistral-7B-AWQ	medium	Unknown	Unknown	TheBloke	42	teknium/OpenHermes-2-Mistral-7B	80.9
CollectiveCognition-v1-Mistral-7B-GGUF	medium	Unknown	Unknown	TheBloke	43	teknium/CollectiveCognition-v1-Mistral-7B	80.85
minotaur-13B-fixed-GGUF	medium	Unknown	Unknown	TheBloke	44	openaccess-ai-collective/minotaur-13b-fixed	80.25
CollectiveCognition-v1.1-Mistral-7B-GGUF	medium	Unknown	Unknown	TheBloke	45	teknium/CollectiveCognition-v1.1-Mistral-7B	79.92
OLMoE-1B-7B-0924	low	Open Data	Unknown	allenai	46	allenai/OLMoE-1B-7B-0924	79.8
Apertus-8B-Instruct-2509-GGUF	low	Unknown	Unknown	unsloth	47	swiss-ai/Apertus-8B-Instruct-2509	79.8
Apertus-70B-Instruct-2509-GGUF	low	Unknown	Unknown	unsloth	48	swiss-ai/Apertus-70B-Instruct-2509	79.8
Apertus-8B-Instruct-2509-unsloth-bnb-4bit	low	Unknown	Unknown	unsloth	49	swiss-ai/Apertus-8B-2509	79.8
Nous-Hermes-13B-GGUF	medium	Unknown	Unknown	TheBloke	50	NousResearch/Nous-Hermes-13b	79.65
Nous-Hermes-13B-SuperHOT-8K-fp16	medium	Unknown	Unknown	TheBloke	51	—	79.65
Nous-Hermes-13B-SuperHOT-8K-GPTQ	medium	Unknown	Unknown	TheBloke	52	—	79.65
Redmond-Puffin-13B-GGUF	medium	Unknown	Unknown	TheBloke	53	NousResearch/Redmond-Puffin-13B	79.54
Redmond-Puffin-13B-GPTQ	medium	Unknown	Unknown	TheBloke	54	NousResearch/Redmond-Puffin-13B	79.54
Tulpar-7B-v0-GGUF	medium	Unknown	Unknown	TheBloke	55	HyperbeeAI/Tulpar-7b-v0	79.05
gemma-3n-E2B-it	medium	[PIQA][]	gemma-3n-e4b	google	56	google/gemma-3n-E4B-it	78.9
gemma-3n-E4B-it	medium	[PIQA][]	gemma-3n-e4b	google	57	google/gemma-3n-E4B	78.9
gemma-3n-E4B-it-litert-lm	medium	[PIQA][]	Unknown	google	58	google/gemma-3n-E4B-it-litert-lm	78.9
gemma-3n-E2B-it-GGUF	medium	[PIQA][]	gemma-3n-e2b-it	unsloth	59	google/gemma-3n-E2B-it	78.9
gemma-3n-E4B-it	medium	[PIQA][]	gemma-3n-e4b	unsloth	60	google/gemma-3n-E4B-it	78.9
gemma-3n-E2B	medium	[PIQA][]	gemma-3n-e4b	google	61	google/gemma-3n-E4B	78.9
gemma-3n-E2B-it-litert-lm	medium	[PIQA][]	Unknown	google	62	google/gemma-3n-E2B-it-litert-lm	78.9
gemma-3n-E4B-it-GGUF	medium	[PIQA][]	gemma-3n-e4b	unsloth	63	google/gemma-3n-E4B-it	78.9
gemma-3n-E4B	medium	[PIQA][]	gemma-3n-e4b	google	64	google/gemma-3n-E4B	78.9
gemma-3n-E2B-it-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3n-e2b-it	unsloth	65	google/gemma-3n-E2B-it	78.9
gemma-3n-E2B-it-litert-preview-GGUF	medium	[PIQA][]	Unknown	unsloth	66	google/gemma-3n-E2B-it-litert-preview	78.9
gemma-3n-E4B-it-litert-preview-GGUF	medium	[PIQA][]	Unknown	unsloth	67	google/gemma-3n-E4B-it-litert-preview	78.9
gemma-3n-E4B-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3n-e4b	unsloth	68	google/gemma-3n-E4B-it	78.9
gemma-3n-E2B-it-ONNX	medium	[PIQA][]	gemma-3n-e2b-it	onnx-community	69	google/gemma-3n-E2B-it	78.9
gemma-3n-E4B-it-GGUF	medium	[PIQA][]	gemma-3n-e4b	Mungert	70	google/gemma-3n-E4B	78.9
gemma-3n-E4B-it-absolute-heresy-MPOA-imatrix-GGUF	medium	[PIQA][]	gemma-3n-e4b-it-absolute-heresy-mpoa	MuXodious	71	MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA	78.9
gemma-3n-E4B-it-absolute-heresy-GGUF	medium	[PIQA][]	gemma-3n-e4b	MuXodious	72	google/gemma-3n-E4B-it	78.9
gemma-3n-E4B-it-absolute-heresy-MPOA-GGUF	medium	[PIQA][]	gemma-3n-e4b-it-absolute-heresy-mpoa	MuXodious	73	MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA	78.9
gemma-3n-E2B-it-GGUF	medium	[PIQA][]	gemma-3n-e4b	Mungert	74	google/gemma-3n-E4b-it	78.9
OLMoE-1B-7B-0125	low	Open Data	olmoe-1b-7b-0125	allenai	75	allenai/OLMoE-1B-7B-0125	78.7
gemma-2-2b-it	medium	[PIQA][]	gemma-2-2b	google	76	google/gemma-2-2b	77.8
gemma-2-2b	medium	[PIQA][]	gemma-2-2b	google	77	google/gemma-2-2b	77.8
Phi-4-mini-instruct	medium	PIQA (5-shot)	phi-4-mini-instruct	microsoft	78	microsoft/Phi-4-mini-instruct	77.6
Phi-4-mini-instruct-GGUF	medium	PIQA (5-shot)	phi-4-mini-instruct	unsloth	79	microsoft/Phi-4-mini-instruct	77.6
Phi-4-mini-instruct-unsloth-bnb-4bit	medium	PIQA (5-shot)	phi-4-mini-instruct	unsloth	80	microsoft/Phi-4-mini-instruct	77.6
Phi-4-mini-instruct-bnb-4bit	medium	PIQA (5-shot)	phi-4-mini-instruct	unsloth	81	microsoft/Phi-4-mini-instruct	77.6
Phi-4-mini-instruct	medium	PIQA (5-shot)	phi-4-mini-instruct	unsloth	82	microsoft/Phi-4-mini-instruct	77.6
Phi-4-mini-instruct-GGUF	medium	PIQA (5-shot)	phi-4-mini-instruct	Mungert	83	microsoft/Phi-4-mini-instruct	77.6
SmolLM2-1.7B-Instruct-GGUF	medium	PIQA	smollm2-1-7b	Mungert	84	HuggingFaceTB/SmolLM2-1.7B	77.6
gemma-1.1-2b-it	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-1-1-2b-it	google	85	google/gemma-1.1-2b-it	77.3
gemma-2b	medium	[PIQA](https://arxiv.org/abs/1911.11641)	Unknown	google	86	google/gemma-2b-it-pytorch	77.3
gemma-2b-it	medium	[PIQA](https://arxiv.org/abs/1911.11641)	Unknown	google	87	google/gemma-2b-it-pytorch	77.3
gemma-7b	medium	[PIQA](https://arxiv.org/abs/1911.11641)	Unknown	google	88	google/gemma-7b-it-quant-pytorch	77.3
gemma-7b-it	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-7b	google	89	google/gemma-7b	77.3
gemma-1.1-7b-it	medium	[PIQA](https://arxiv.org/abs/1911.11641)	gemma-1-1-7b-it	google	90	google/gemma-1.1-7b-it	77.3
gemma-2b-AWQ	medium	[PIQA](https://arxiv.org/abs/1911.11641)	Unknown	google	91	google/gemma-2b-it-pytorch	77.3
gemma-7b	medium	[PIQA](https://arxiv.org/abs/1911.11641)	Unknown	alpindale	92	google/gemma-7b-it-quant-pytorch	77.3
gemma-2b	medium	[PIQA](https://arxiv.org/abs/1911.11641)	Unknown	alpindale	93	google/gemma-2b-it-pytorch	77.3
gemma-7b-AWQ	medium	[PIQA](https://arxiv.org/abs/1911.11641)	Unknown	google	94	google/gemma-7b-it-quant-pytorch	77.3
gemma-7b-it	medium	[PIQA](https://arxiv.org/abs/1911.11641)	Unknown	alpindale	95	google/gemma-7b-it-quant-pytorch	77.3
gemma-7b-GGUF	medium	[PIQA](https://arxiv.org/abs/1911.11641)	Unknown	google	96	google/gemma-7b-it-quant-pytorch	77.3
OLMo-1B-0724-hf	medium	Unknown	olmo-1b-0724-hf	allenai	97	allenai/OLMo-1B-0724-hf	77.2
OLMo-7B-0424-hf	medium	Unknown	olmo-7b-0424-hf	allenai	98	allenai/OLMo-7B-0424-hf	77.2
OLMo-7B-0724-hf	medium	Unknown	olmo-7b-0724-hf	allenai	99	allenai/OLMo-7B-0724-hf	77.2
OLMo-7B-0424	medium	Unknown	Unknown	allenai	100	allenai/OLMo-7B-0424	77.2
Llama2-7b-WhoIsHarryPotter	low	Unknown	Unknown	microsoft	101	microsoft/Llama2-7b-WhoIsHarryPotter	76.7
MobileLLM-Pro-base	medium	PIQA	mobilellm-pro-base	facebook	102	facebook/MobileLLM-Pro-base	76.55
MobileLLM-Pro	medium	PIQA	mobilellm-pro-base	facebook	103	facebook/MobileLLM-Pro-base	76.55
OLMo-1B-hf	medium	Unknown	olmo-1b-hf	allenai	104	allenai/OLMo-1B-hf	76.3
OLMo-7B	medium	Unknown	olmo-7b	allenai	105	allenai/OLMo-7B	76.3
OLMo-7B-hf	medium	Unknown	olmo-7b-hf	allenai	106	allenai/OLMo-7B-hf	76.3
OLMo-1B	medium	Unknown	olmo-1b	allenai	107	allenai/OLMo-1B	76.3
OLMo-7B-Twin-2T-hf	medium	Unknown	olmo-7b-twin-2t-hf	allenai	108	allenai/OLMo-7B-Twin-2T-hf	76.3
OLMo-7B-Twin-2T	medium	Unknown	olmo-7b-twin-2t	allenai	109	allenai/OLMo-7B-Twin-2T	76.3
nemo-megatron-gpt-5B	low	Unknown	Unknown	nvidia	110	nvidia/nemo-megatron-gpt-5B	74.92
bitnet-b1.58-2B-4T-gguf	medium	PIQA	bitnet-b1-58-2b-4t-bf16	microsoft	111	microsoft/bitnet-b1.58-2B-4T-bf16	74.21
bitnet-b1.58-2B-4T	medium	PIQA	bitnet-b1-58-2b-4t	microsoft	112	microsoft/bitnet-b1.58-2B-4T	74.21
bitnet-b1.58-2B-4T-bf16	medium	PIQA	bitnet-b1-58-2b-4t-bf16	microsoft	113	microsoft/bitnet-b1.58-2B-4T-bf16	74.21
gemma-3-1b-it	medium	[PIQA][]	gemma-3-1b-pt	google	114	google/gemma-3-1b-pt	73.8
gemma-3-4b-it	medium	[PIQA][]	gemma-3-4b-pt	google	115	google/gemma-3-4b-pt	73.8
gemma-3-12b-it	medium	[PIQA][]	gemma-3-12b-pt	google	116	google/gemma-3-12b-pt	73.8
gemma-3-27b-it	medium	[PIQA][]	gemma-3-27b-pt	google	117	google/gemma-3-27b-pt	73.8
gemma-3-4b-it	medium	[PIQA][]	gemma-3-4b-pt	unsloth	118	google/gemma-3-4b-it	73.8
gemma-3-1b-it-GGUF	medium	[PIQA][]	gemma-3-1b-pt	ggml-org	119	google/gemma-3-1b-it	73.8
gemma-3-12b-it-qat-q4_0-unquantized	medium	[PIQA][]	gemma-3-12b-pt	google	120	google/gemma-3-12b-it	73.8
gemma-3-1b-it	medium	[PIQA][]	gemma-3-1b-pt	unsloth	121	google/gemma-3-1b-it	73.8
gemma-3-12b-it-GGUF	medium	[PIQA][]	gemma-3-12b-pt	unsloth	122	google/gemma-3-12b-it	73.8
gemma-3-4b-pt	medium	[PIQA][]	gemma-3-4b-pt	google	123	google/gemma-3-4b-pt	73.8
gemma-3-12b-it-qat-GGUF	medium	[PIQA][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	124	google/gemma-3-12b-it-qat-q4_0-unquantized	73.8
gemma-3-27b-it	medium	[PIQA][]	gemma-3-27b-it	unsloth	125	google/gemma-3-27b-it	73.8
gemma-3-1b-pt	medium	[PIQA][]	gemma-3-1b-pt	google	126	google/gemma-3-1b-pt	73.8
gemma-3-4b-it-GGUF	medium	[PIQA][]	gemma-3-4b-pt	ggml-org	127	google/gemma-3-4b-it	73.8
gemma-3-4b-it-GGUF	medium	[PIQA][]	gemma-3-4b-pt	unsloth	128	google/gemma-3-4b-it	73.8
gemma-3-1b-it-GGUF	medium	[PIQA][]	gemma-3-1b-pt	unsloth	129	google/gemma-3-1b-it	73.8
gemma-3-12b-pt	medium	[PIQA][]	Unknown	google	130	google/gemma-3-12b	73.8
gemma-3-12b-it-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-12b-pt	unsloth	131	google/gemma-3-12b-it	73.8
gemma-3-4b-it-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-4b-pt	unsloth	132	google/gemma-3-4b-it	73.8
gemma-3-12b-it	medium	[PIQA][]	gemma-3-12b-pt	unsloth	133	google/gemma-3-12b-pt	73.8
gemma-3-27b-it-GGUF	medium	[PIQA][]	gemma-3-27b-it	unsloth	134	google/gemma-3-27b-it	73.8
gemma-3-1b-it-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-1b-pt	unsloth	135	google/gemma-3-1b-it	73.8
gemma-3-4b-it-bnb-4bit	medium	[PIQA][]	gemma-3-4b-pt	unsloth	136	google/gemma-3-4b-it	73.8
gemma-3-4b-pt	medium	[PIQA][]	gemma-3-4b-pt	unsloth	137	google/gemma-3-4b-pt	73.8
gemma-3-27b-pt	medium	[PIQA][]	gemma-3-27b-pt	google	138	google/gemma-3-27b-pt	73.8
gemma-3-12b-it-bnb-4bit	medium	[PIQA][]	gemma-3-12b-pt	unsloth	139	google/gemma-3-12b-it	73.8
gemma-3-27b-it-GGUF	medium	[PIQA][]	gemma-3-27b-it	ggml-org	140	google/gemma-3-27b-it	73.8
gemma-3-12b-pt	medium	[PIQA][]	gemma-3-12b-pt	unsloth	141	google/gemma-3-12b-pt	73.8
gemma-3-27b-it-bnb-4bit	medium	[PIQA][]	gemma-3-27b-it	unsloth	142	google/gemma-3-27b-it	73.8
gemma-3-27b-it-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-27b-it	unsloth	143	google/gemma-3-27b-it	73.8
gemma-3-1b-pt	medium	[PIQA][]	gemma-3-1b-pt	unsloth	144	google/gemma-3-1b-pt	73.8
gemma-3-12b-it-GGUF	medium	[PIQA][]	gemma-3-12b-pt	ggml-org	145	google/gemma-3-12b-it	73.8
gemma-3-4b-it-qat-GGUF	medium	[PIQA][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	146	google/gemma-3-4b-it-qat-q4_0-unquantized	73.8
gemma-3-12b-it-qat-bnb-4bit	medium	[PIQA][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	147	google/gemma-3-12b-it-qat-q4_0-unquantized	73.8
gemma-3-12b-it-qat-int4-GGUF	medium	[PIQA][]	gemma-3-12b-it-qat-int4-unquantized	unsloth	148	google/gemma-3-12b-it-qat-int4-unquantized	73.8
gemma-3-4b-it-qat-q4_0-gguf	medium	[PIQA][]	gemma-3-4b-pt	google	149	google/gemma-3-4b-it	73.8
gemma-3-4b-it-qat-q4_0-unquantized	medium	[PIQA][]	gemma-3-4b-pt	google	150	google/gemma-3-4b-it	73.8
gemma-3-4b-pt-bnb-4bit	medium	[PIQA][]	gemma-3-4b-pt	unsloth	151	google/gemma-3-4b-pt	73.8
gemma-3-27b-it-qat-GGUF	medium	[PIQA][]	gemma-3-27b-it-qat-q4-0-unquantized	unsloth	152	google/gemma-3-27b-it-qat-q4_0-unquantized	73.8
gemma-3-12b-it-qat-q4_0-gguf	medium	[PIQA][]	gemma-3-12b-pt	google	153	google/gemma-3-12b-it	73.8
gemma-3-1b-it-bnb-4bit	medium	[PIQA][]	gemma-3-1b-pt	unsloth	154	google/gemma-3-1b-it	73.8
gemma-3-1b-it-qat-q4_0-gguf	medium	[PIQA][]	gemma-3-1b-pt	google	155	google/gemma-3-1b-it	73.8
gemma-3-4b-pt-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-4b-pt	unsloth	156	google/gemma-3-4b-pt	73.8
gemma-3-12b-it-qat	medium	[PIQA][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	157	google/gemma-3-12b-it-qat-q4_0-unquantized	73.8
gemma-3-1b-pt-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-1b-pt	unsloth	158	google/gemma-3-1b-pt	73.8
gemma-3-4b-it-FP8-Dynamic	medium	[PIQA][]	gemma-3-4b-pt	unsloth	159	google/gemma-3-4b-it	73.8
gemma-3-12b-pt-bnb-4bit	medium	[PIQA][]	gemma-3-12b-pt	unsloth	160	google/gemma-3-12b-pt	73.8
gemma-3-12b-it-qat-int4-unquantized	medium	[PIQA][]	gemma-3-12b-pt	google	161	google/gemma-3-12b-it	73.8
gemma-3-27b-it-GGUF	medium	[PIQA][]	gemma-3-27b-pt	Mungert	162	google/gemma-3-27b-pt	73.8
gemma-3-27b-it-qat-q4_0-unquantized	medium	[PIQA][]	gemma-3-27b-it	google	163	google/gemma-3-27b-it	73.8
gemma-3-12b-pt-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-12b-pt	unsloth	164	google/gemma-3-12b-pt	73.8
gemma-3-27b-it-qat-q4_0-gguf	medium	[PIQA][]	gemma-3-27b-it	google	165	google/gemma-3-27b-it	73.8
gemma-3-27b-it-qat-q4_0-GGUF	medium	[PIQA][]	gemma-3-27b-it	Mungert	166	google/gemma-3-27b-it	73.8
gemma-3-4b-it-qat-bnb-4bit	medium	[PIQA][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	167	google/gemma-3-4b-it-qat-q4_0-unquantized	73.8
gemma-3-1b-pt-bnb-4bit	medium	[PIQA][]	gemma-3-1b-pt	unsloth	168	google/gemma-3-1b-pt	73.8
gemma-3-27b-pt	medium	[PIQA][]	gemma-3-27b-pt	unsloth	169	google/gemma-3-27b-pt	73.8
gemma-3-12b-it-FP8-Dynamic	medium	[PIQA][]	gemma-3-12b-pt	unsloth	170	google/gemma-3-12b-pt	73.8
gemma-3-1b-it-qat-int4-unquantized	medium	[PIQA][]	gemma-3-1b-pt	google	171	google/gemma-3-1b-it	73.8
gemma-3-27b-pt-bnb-4bit	medium	[PIQA][]	gemma-3-27b-pt	unsloth	172	google/gemma-3-27b-pt	73.8
gemma-3-12b-it-qat-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	173	google/gemma-3-12b-it-qat-q4_0-unquantized	73.8
gemma-3-12b-pt-qat-q4_0-gguf	medium	[PIQA][]	gemma-3-12b-pt	google	174	google/gemma-3-12b-pt	73.8
gemma-3-4b-it-qat	medium	[PIQA][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	175	google/gemma-3-4b-it-qat-q4_0-unquantized	73.8
gemma-3-1b-it-qat-q4_0-unquantized	medium	[PIQA][]	gemma-3-1b-pt	google	176	google/gemma-3-1b-it	73.8
gemma-3-1b-it-qat	medium	[PIQA][]	gemma-3-1b-it-qat-q4-0-unquantized	unsloth	177	google/gemma-3-1b-it-qat-q4_0-unquantized	73.8
gemma-3-27b-it-qat	medium	[PIQA][]	gemma-3-27b-it-qat-q4-0-unquantized	unsloth	178	google/gemma-3-27b-it-qat-q4_0-unquantized	73.8
gemma-3-4b-pt-qat-q4_0-gguf	medium	[PIQA][]	gemma-3-4b-pt	google	179	google/gemma-3-4b-pt	73.8
TinyLlama-1.1B-intermediate-step-1431k-3T-GGUF	high	Unknown	Unknown	TheBloke	180	TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T	73.29
SmolLM2-360M-Instruct-GGUF	medium	PIQA	smollm2-360m	Mungert	181	HuggingFaceTB/SmolLM2-360M	71.7
TinyLlama-1.1B-intermediate-step-715k-1.5T-GGUF	high	Unknown	Unknown	TheBloke	182	PY007/TinyLlama-1.1B-intermediate-step-715k-1.5T	71.65
SmolLM2-135M-Instruct-GGUF	medium	PIQA	smollm2-135m	Mungert	183	HuggingFaceTB/SmolLM2-135M	68.4
vaultgemma-1b	medium	[PIQA][]	Unknown	google	184	google/vaultgemma-1b	68
gemma-3-270m	medium	[PIQA][]	gemma-3-270m	google	185	google/gemma-3-270m	67.7
gemma-3-270m-it	medium	[PIQA][]	gemma-3-270m	google	186	google/gemma-3-270m	67.7
gemma-3-270m-it-GGUF	medium	[PIQA][]	gemma-3-270m-it	unsloth	187	google/gemma-3-270m-it	67.7
gemma-3-270m-it	medium	[PIQA][]	gemma-3-270m-it	unsloth	188	google/gemma-3-270m-it	67.7
gemma-3-270m-it-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-270m-it	unsloth	189	google/gemma-3-270m-it	67.7
gemma-3-270m-it-qat-GGUF	medium	[PIQA][]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	190	google/gemma-3-270m-it-qat-q4_0-unquantized	67.7
gemma-3-270m	medium	[PIQA][]	gemma-3-270m	unsloth	191	google/gemma-3-270m	67.7
gemma-3-270m-unsloth-bnb-4bit	medium	[PIQA][]	gemma-3-270m-it	unsloth	192	google/gemma-3-270m-it	67.7
gemma-3-270m-it-qat-q4_0-unquantized	medium	[PIQA][]	gemma-3-270m-it	google	193	google/gemma-3-270m-it	67.7
gemma-3-270m-it-bnb-4bit	medium	[PIQA][]	gemma-3-270m-it	unsloth	194	google/gemma-3-270m-it	67.7
gemma-3-270m-it-qat	medium	[PIQA][]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	195	google/gemma-3-270m-it-qat-q4_0-unquantized	67.7
gemma-3-270m-bnb-4bit	medium	[PIQA][]	gemma-3-270m	unsloth	196	google/gemma-3-270m	67.7
gemma-3-270m-qat-q4_0-unquantized	medium	[PIQA][]	gemma-3-270m	google	197	google/gemma-3-270m	67.7
gemma-3-270m-it-GGUF	medium	[PIQA][]	gemma-3-270m	Mungert	198	google/gemma-3-270m	67.7
gemma-3-270m-it-torchao-FP8	medium	[PIQA][]	gemma-3-270m-it	unsloth	199	google/gemma-3-270m-it	67.7
t5gemma-2-270m-270m	medium	[PIQA]	t5gemma-2-270m-270m	google	200	google/t5gemma-2-270m-270m	66.5
t5gemma-2-4b-4b	medium	[PIQA]	t5gemma-2-4b-4b	google	201	google/t5gemma-2-4b-4b	66.5
t5gemma-2-1b-1b	medium	[PIQA]	t5gemma-2-1b-1b	google	202	google/t5gemma-2-1b-1b	66.5
Redmond-Hermes-Coder-GPTQ	medium	Unknown	Unknown	TheBloke	203	—	66
MobileLLM-125M	low	Unknown	Unknown	facebook	204	facebook/MobileLLM-125M	62

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/piqa.html
url: huggingface.co/spaces/piqa ↗