Leaderboard

BoolQ

boolq

Record

Category: knowledge
Scored models: 178

Scores

Model	Score
NousResearch/Nous-Hermes-2-SOLAR-10.7B	88.75
NousResearch/Nous-Hermes-2-Yi-34B	88.59
NousResearch/Nous-Hermes-2-Yi-34B	88.59
AIDC-ai-business/Marcoroni-7B-v3	88.56
mlabonne/Beyonder-4x7B-v2	88.35
mlabonne/Marcoro14-7B-slerp	88.35
jondurbin/bagel-dpo-7b-v0.1	88.13
NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	87.83
NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	87.83
NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	87.83
fblgit/juanako-7b-UNA	87.03
macadeliccc/laser-dolphin-mixtral-2x7b-dpo	86.94
teknium/OpenHermes-2-Mistral-7B	86.88
teknium/OpenHermes-2-Mistral-7B	86.88
teknium/OpenHermes-2.5-Mistral-7B	86.7
teknium/OpenHermes-2.5-Mistral-7B	86.57
teknium/OpenHermes-2.5-Mistral-7B	86.57
NurtureAI/OpenHermes-2.5-Mistral-7B-16k	86.57
teknium/OpenHermes-2.5-Mistral-7B	86.57
microsoft/Phi-3-medium-128k-instruct	86.5
microsoft/Phi-3-medium-4k-instruct	86.5
fblgit/UNAversal-8x7B-v1beta	86.24
openaccess-ai-collective/DPOpenHermes-7B	85.99
teknium/CollectiveCognition-v1-Mistral-7B	85.38

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: knowledge
id: boolq
name: BoolQ
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	boolq	nous-hermes-2-solar-10-7b	TheBloke	1	NousResearch/Nous-Hermes-2-SOLAR-10.7B	88.75
Nous-Hermes-2-Yi-34B-GGUF	medium	boolq	nous-hermes-2-yi-34b	TheBloke	2	NousResearch/Nous-Hermes-2-Yi-34B	88.59
Nous-Hermes-2-Yi-34B-AWQ	medium	boolq	nous-hermes-2-yi-34b	TheBloke	3	NousResearch/Nous-Hermes-2-Yi-34B	88.59
Marcoro14-7B-slerp	medium	boolq	marcoro14-7b-slerp	mlabonne	4	AIDC-ai-business/Marcoroni-7B-v3	88.56
Beyonder-4x7B-v2-GGUF	medium	boolq	beyonder-4x7b-v2	TheBloke	5	mlabonne/Beyonder-4x7B-v2	88.35
Beyonder-4x7B-v2	medium	boolq	marcoro14-7b-slerp	mlabonne	6	mlabonne/Marcoro14-7B-slerp	88.35
bagel-dpo-7B-v0.1-GGUF	high	boolq	bagel-dpo-7b-v0-1	TheBloke	7	jondurbin/bagel-dpo-7b-v0.1	88.13
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	boolq	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	8	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	87.83
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	boolq	nous-hermes-2-mixtral-8x7b-sft	TheBloke	9	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	87.83
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	boolq	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	10	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	87.83
juanako-7B-UNA-GGUF	medium	boolq	juanako-7b-una	TheBloke	11	fblgit/juanako-7b-UNA	87.03
laser-dolphin-mixtral-2x7b-dpo-GGUF	medium	boolq	laser-dolphin-mixtral-2x7b-dpo	TheBloke	12	macadeliccc/laser-dolphin-mixtral-2x7b-dpo	86.94
OpenHermes-2-Mistral-7B-GGUF	medium	boolq	mistral-7b-v0-1	TheBloke	13	teknium/OpenHermes-2-Mistral-7B	86.88
OpenHermes-2-Mistral-7B-AWQ	medium	boolq	mistral-7b-v0-1	TheBloke	14	teknium/OpenHermes-2-Mistral-7B	86.88
NeuralHermes-2.5-Mistral-7B-laser	medium	boolq	openhermes-2-5-mistral-7b	mlabonne	15	teknium/OpenHermes-2.5-Mistral-7B	86.7
OpenHermes-2.5-Mistral-7B-AWQ	medium	boolq	openhermes-2-5-mistral-7b	TheBloke	16	teknium/OpenHermes-2.5-Mistral-7B	86.57
OpenHermes-2.5-Mistral-7B-GGUF	medium	boolq	openhermes-2-5-mistral-7b	TheBloke	17	teknium/OpenHermes-2.5-Mistral-7B	86.57
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	boolq	Unknown	TheBloke	18	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	86.57
OpenHermes-2.5-Mistral-7B-GPTQ	medium	boolq	openhermes-2-5-mistral-7b	TheBloke	19	teknium/OpenHermes-2.5-Mistral-7B	86.57
Phi-3-medium-128k-instruct	medium	BoolQ<br>2-shot	phi-3-medium-128k-instruct	microsoft	20	microsoft/Phi-3-medium-128k-instruct	86.5
Phi-3-medium-4k-instruct	medium	BoolQ<br>2-shot	phi-3-medium-4k-instruct	microsoft	21	microsoft/Phi-3-medium-4k-instruct	86.5
UNAversal-8x7B-v1beta-GGUF	medium	boolq	unaversal-8x7b-v1beta	TheBloke	22	fblgit/UNAversal-8x7B-v1beta	86.24
DPOpenHermes-7B-GGUF	medium	boolq	dpopenhermes-7b	TheBloke	23	openaccess-ai-collective/DPOpenHermes-7B	85.99
CollectiveCognition-v1-Mistral-7B-GGUF	medium	boolq	mistral-7b-v0-1	TheBloke	24	teknium/CollectiveCognition-v1-Mistral-7B	85.38
CollectiveCognition-v1.1-Mistral-7B-GGUF	medium	boolq	mistral-7b-v0-1	TheBloke	25	teknium/CollectiveCognition-v1.1-Mistral-7B	84.95
Phi-3-small-8k-instruct	medium	BoolQ<br>2-shot	phi-3-small-8k-instruct	microsoft	26	microsoft/Phi-3-small-8k-instruct	84.8
Nous-Hermes-Llama2-70B-GGUF	medium	boolq	Unknown	TheBloke	27	NousResearch/Nous-Hermes-Llama2-70b	84.22
gemma-2-9b-it	medium	[BoolQ][]	gemma-2-9b	google	28	google/gemma-2-9b	84.2
gemma-2-27b-it	medium	[BoolQ][]	gemma-2-27b	google	29	google/gemma-2-27b	84.2
gemma-2-9b	medium	[BoolQ][]	gemma-2-9b	google	30	google/gemma-2-9b	84.2
gemma-2-27b	medium	[BoolQ][]	gemma-2-27b	google	31	google/gemma-2-27b	84.2
UNA-ThePitbull-21.4B-v2-GGUF	medium	boolq	Unknown	bartowski	32	—	84.01
Phi-3-small-128k-instruct	medium	BoolQ<br>2-shot	phi-3-small-128k-instruct	microsoft	33	microsoft/Phi-3-small-128k-instruct	83.7
juanako-7B-v1-GGUF	medium	boolq	juanako-7b-v1	TheBloke	34	fblgit/juanako-7b-v1	83.55
GRIN-MoE	medium	BoolQ	grin-moe	microsoft	35	microsoft/GRIN-MoE	83.4
Tulpar-7B-v0-GGUF	medium	boolq	Unknown	TheBloke	36	HyperbeeAI/Tulpar-7b-v0	83.06
Redmond-Puffin-13B-GGUF	medium	boolq	Unknown	TheBloke	37	NousResearch/Redmond-Puffin-13B	81.5
Redmond-Puffin-13B-GPTQ	medium	boolq	Unknown	TheBloke	38	NousResearch/Redmond-Puffin-13B	81.5
minotaur-13B-fixed-GGUF	medium	boolq	Unknown	TheBloke	39	openaccess-ai-collective/minotaur-13b-fixed	81.41
Phi-4-mini-instruct	medium	BoolQ (2-shot)	phi-4-mini-instruct	microsoft	40	microsoft/Phi-4-mini-instruct	81.2
Phi-4-mini-instruct-GGUF	medium	BoolQ (2-shot)	phi-4-mini-instruct	unsloth	41	microsoft/Phi-4-mini-instruct	81.2
Phi-4-mini-instruct-unsloth-bnb-4bit	medium	BoolQ (2-shot)	phi-4-mini-instruct	unsloth	42	microsoft/Phi-4-mini-instruct	81.2
Phi-4-mini-instruct-bnb-4bit	medium	BoolQ (2-shot)	phi-4-mini-instruct	unsloth	43	microsoft/Phi-4-mini-instruct	81.2
Phi-4-mini-instruct	medium	BoolQ (2-shot)	phi-4-mini-instruct	unsloth	44	microsoft/Phi-4-mini-instruct	81.2
Phi-4-mini-instruct-GGUF	medium	BoolQ (2-shot)	phi-4-mini-instruct	Mungert	45	microsoft/Phi-4-mini-instruct	81.2
Llama2-7b-WhoIsHarryPotter	low	BoolQ	Unknown	microsoft	46	microsoft/Llama2-7b-WhoIsHarryPotter	80.7
Nous-Hermes-13B-GGUF	medium	boolq	Unknown	TheBloke	47	NousResearch/Nous-Hermes-13b	79.48
Nous-Hermes-13B-SuperHOT-8K-fp16	medium	boolq	Unknown	TheBloke	48	—	79.48
Nous-Hermes-13B-SuperHOT-8K-GPTQ	medium	boolq	Unknown	TheBloke	49	—	79.48
gemma-3n-E2B-it	medium	[BoolQ][]	gemma-3n-e4b	google	50	google/gemma-3n-E4B-it	76.4
gemma-3n-E4B-it	medium	[BoolQ][]	gemma-3n-e4b	google	51	google/gemma-3n-E4B	76.4
gemma-3n-E4B-it-litert-lm	medium	[BoolQ][]	gemma-3n-e4b	google	52	google/gemma-3n-E4B-it-litert-lm	76.4
gemma-3n-E2B-it-GGUF	medium	[BoolQ][]	gemma-3n-e2b-it	unsloth	53	google/gemma-3n-E2B-it	76.4
gemma-3n-E4B-it	medium	[BoolQ][]	gemma-3n-e4b	unsloth	54	google/gemma-3n-E4B-it	76.4
gemma-3n-E2B	medium	[BoolQ][]	gemma-3n-e4b	google	55	google/gemma-3n-E4B	76.4
gemma-3n-E2B-it-litert-lm	medium	[BoolQ][]	gemma-3n-e2b-it	google	56	google/gemma-3n-E2B-it-litert-lm	76.4
gemma-3n-E4B-it-GGUF	medium	[BoolQ][]	gemma-3n-e4b	unsloth	57	google/gemma-3n-E4B-it	76.4
gemma-3n-E4B	medium	[BoolQ][]	gemma-3n-e4b	google	58	google/gemma-3n-E4B	76.4
gemma-3n-E2B-it-unsloth-bnb-4bit	medium	[BoolQ][]	gemma-3n-e2b-it	unsloth	59	google/gemma-3n-E2B-it	76.4
gemma-3n-E2B-it-litert-preview-GGUF	medium	[BoolQ][]	gemma-3n-e2b-it	unsloth	60	google/gemma-3n-E2B-it-litert-preview	76.4
gemma-3n-E4B-it-litert-preview-GGUF	medium	[BoolQ][]	gemma-3n-e4b	unsloth	61	google/gemma-3n-E4B-it-litert-preview	76.4
gemma-3n-E4B-unsloth-bnb-4bit	medium	[BoolQ][]	gemma-3n-e4b	unsloth	62	google/gemma-3n-E4B-it	76.4
gemma-3n-E2B-it-ONNX	medium	[BoolQ][]	gemma-3n-e2b-it	onnx-community	63	google/gemma-3n-E2B-it	76.4
gemma-3n-E4B-it-GGUF	medium	[BoolQ][]	gemma-3n-e4b	Mungert	64	google/gemma-3n-E4B	76.4
gemma-3n-E4B-it-absolute-heresy-MPOA-imatrix-GGUF	medium	[BoolQ][]	gemma-3n-e4b-it-absolute-heresy-mpoa	MuXodious	65	MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA	76.4
gemma-3n-E4B-it-absolute-heresy-GGUF	medium	[BoolQ][]	gemma-3n-e4b	MuXodious	66	google/gemma-3n-E4B-it	76.4
gemma-3n-E4B-it-absolute-heresy-MPOA-GGUF	medium	[BoolQ][]	gemma-3n-e4b-it-absolute-heresy-mpoa	MuXodious	67	MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA	76.4
gemma-3n-E2B-it-GGUF	medium	[BoolQ][]	gemma-3n-e4b	Mungert	68	google/gemma-3n-E4b-it	76.4
MobileLLM-Pro-base	medium	BoolQ	mobilellm-pro-base	facebook	69	facebook/MobileLLM-Pro-base	76.24
MobileLLM-Pro	medium	BoolQ	mobilellm-pro-base	facebook	70	facebook/MobileLLM-Pro-base	76.24
OLMo-1B-0724-hf	medium	boolq	olmo-1b-0724-hf	allenai	71	allenai/OLMo-1B-0724-hf	75.4
OLMo-7B-0424-hf	medium	boolq	olmo-7b-0424-hf	allenai	72	allenai/OLMo-7B-0424-hf	75.4
OLMo-7B-0724-hf	medium	boolq	olmo-7b-0724-hf	allenai	73	allenai/OLMo-7B-0724-hf	75.4
OLMo-7B-0424	medium	boolq	Unknown	allenai	74	allenai/OLMo-7B-0424	75.4
OLMo-1B-hf	medium	boolq	olmo-1b-hf	allenai	75	allenai/OLMo-1B-hf	73.1
OLMo-7B	medium	boolq	olmo-7b	allenai	76	allenai/OLMo-7B	73.1
OLMo-7B-hf	medium	boolq	olmo-7b-hf	allenai	77	allenai/OLMo-7B-hf	73.1
OLMo-1B	medium	boolq	olmo-1b	allenai	78	allenai/OLMo-1B	73.1
OLMo-7B-Twin-2T-hf	medium	boolq	olmo-7b-twin-2t-hf	allenai	79	allenai/OLMo-7B-Twin-2T-hf	73.1
OLMo-7B-Twin-2T	medium	boolq	olmo-7b-twin-2t	allenai	80	allenai/OLMo-7B-Twin-2T	73.1
gemma-2-2b-it	medium	[BoolQ][]	gemma-2-2b	google	81	google/gemma-2-2b	72.5
gemma-2-2b	medium	[BoolQ][]	gemma-2-2b	google	82	google/gemma-2-2b	72.5
Nemotron-4-Mini-Hindi-4B-Base	low	BoolQ	Unknown	nvidia	83	nvidia/Minitron-4B-Base	71.71
Nemotron-4-Mini-Hindi-4B-Base-GGUF	low	BoolQ	Unknown	Mungert	84	nvidia/Minitron-4B-Base	71.71
bitnet-b1.58-2B-4T-gguf	medium	BoolQ	bitnet-b1-58-2b-4t-bf16	microsoft	85	microsoft/bitnet-b1.58-2B-4T-bf16	64.65
bitnet-b1.58-2B-4T	medium	BoolQ	bitnet-b1-58-2b-4t	microsoft	86	microsoft/bitnet-b1.58-2B-4T	64.65
bitnet-b1.58-2B-4T-bf16	medium	BoolQ	bitnet-b1-58-2b-4t-bf16	microsoft	87	microsoft/bitnet-b1.58-2B-4T-bf16	64.65
gemma-3-1b-it	medium	[BoolQ][]	gemma-3-1b-it	google	88	google/gemma-3-1b-pt	63.2
gemma-3-4b-it	medium	[BoolQ][]	gemma-3-4b-it	google	89	google/gemma-3-4b-pt	63.2
gemma-3-12b-it	medium	[BoolQ][]	gemma-3-12b-pt	google	90	google/gemma-3-12b-pt	63.2
gemma-3-27b-it	medium	[BoolQ][]	gemma-3-27b-pt	google	91	google/gemma-3-27b-pt	63.2
gemma-3-4b-it	medium	[BoolQ][]	gemma-3-4b-it	unsloth	92	google/gemma-3-4b-it	63.2
gemma-3-1b-it-GGUF	medium	[BoolQ][]	gemma-3-1b-it	ggml-org	93	google/gemma-3-1b-it	63.2
gemma-3-12b-it-qat-q4_0-unquantized	medium	[BoolQ][]	gemma-3-12b-it	google	94	google/gemma-3-12b-it	63.2
gemma-3-1b-it	medium	[BoolQ][]	gemma-3-1b-it	unsloth	95	google/gemma-3-1b-it	63.2
gemma-3-12b-it-GGUF	medium	[BoolQ][]	gemma-3-12b-it	unsloth	96	google/gemma-3-12b-it	63.2
gemma-3-4b-pt	medium	[BoolQ][]	gemma-3-4b-pt	google	97	google/gemma-3-4b-pt	63.2
gemma-3-12b-it-qat-GGUF	medium	[BoolQ][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	98	google/gemma-3-12b-it-qat-q4_0-unquantized	63.2
gemma-3-27b-it	medium	[BoolQ][]	gemma-3-27b-it	unsloth	99	google/gemma-3-27b-it	63.2
gemma-3-1b-pt	medium	[BoolQ][]	gemma-3-1b-pt	google	100	google/gemma-3-1b-pt	63.2
gemma-3-4b-it-GGUF	medium	[BoolQ][]	gemma-3-4b-it	ggml-org	101	google/gemma-3-4b-it	63.2
gemma-3-4b-it-GGUF	medium	[BoolQ][]	gemma-3-4b-it	unsloth	102	google/gemma-3-4b-it	63.2
gemma-3-1b-it-GGUF	medium	[BoolQ][]	gemma-3-1b-it	unsloth	103	google/gemma-3-1b-it	63.2
gemma-3-12b-pt	medium	[BoolQ][]	gemma-3-12b-pt	google	104	google/gemma-3-12b	63.2
gemma-3-12b-it-unsloth-bnb-4bit	medium	[BoolQ][]	gemma-3-12b-it	unsloth	105	google/gemma-3-12b-it	63.2
gemma-3-4b-it-unsloth-bnb-4bit	medium	[BoolQ][]	gemma-3-4b-it	unsloth	106	google/gemma-3-4b-it	63.2
gemma-3-12b-it	medium	[BoolQ][]	gemma-3-12b-pt	unsloth	107	google/gemma-3-12b-pt	63.2
gemma-3-27b-it-GGUF	medium	[BoolQ][]	gemma-3-27b-it	unsloth	108	google/gemma-3-27b-it	63.2
gemma-3-1b-it-unsloth-bnb-4bit	medium	[BoolQ][]	gemma-3-1b-it	unsloth	109	google/gemma-3-1b-it	63.2
gemma-3-4b-it-bnb-4bit	medium	[BoolQ][]	gemma-3-4b-it	unsloth	110	google/gemma-3-4b-it	63.2
gemma-3-4b-pt	medium	[BoolQ][]	gemma-3-4b-pt	unsloth	111	google/gemma-3-4b-pt	63.2
gemma-3-27b-pt	medium	[BoolQ][]	gemma-3-27b-pt	google	112	google/gemma-3-27b-pt	63.2
gemma-3-12b-it-bnb-4bit	medium	[BoolQ][]	gemma-3-12b-it	unsloth	113	google/gemma-3-12b-it	63.2
gemma-3-27b-it-GGUF	medium	[BoolQ][]	gemma-3-27b-it	ggml-org	114	google/gemma-3-27b-it	63.2
gemma-3-12b-pt	medium	[BoolQ][]	gemma-3-12b-pt	unsloth	115	google/gemma-3-12b-pt	63.2
gemma-3-27b-it-bnb-4bit	medium	[BoolQ][]	gemma-3-27b-it	unsloth	116	google/gemma-3-27b-it	63.2
gemma-3-27b-it-unsloth-bnb-4bit	medium	[BoolQ][]	gemma-3-27b-it	unsloth	117	google/gemma-3-27b-it	63.2
gemma-3-1b-pt	medium	[BoolQ][]	gemma-3-1b-pt	unsloth	118	google/gemma-3-1b-pt	63.2
gemma-3-12b-it-GGUF	medium	[BoolQ][]	gemma-3-12b-it	ggml-org	119	google/gemma-3-12b-it	63.2
gemma-3-4b-it-qat-GGUF	medium	[BoolQ][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	120	google/gemma-3-4b-it-qat-q4_0-unquantized	63.2
gemma-3-12b-it-qat-bnb-4bit	medium	[BoolQ][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	121	google/gemma-3-12b-it-qat-q4_0-unquantized	63.2
gemma-3-12b-it-qat-int4-GGUF	medium	[BoolQ][]	gemma-3-12b-it-qat-int4-unquantized	unsloth	122	google/gemma-3-12b-it-qat-int4-unquantized	63.2
gemma-3-4b-it-qat-q4_0-gguf	medium	[BoolQ][]	gemma-3-4b-it	google	123	google/gemma-3-4b-it	63.2
gemma-3-4b-it-qat-q4_0-unquantized	medium	[BoolQ][]	gemma-3-4b-it	google	124	google/gemma-3-4b-it	63.2
gemma-3-4b-pt-bnb-4bit	medium	[BoolQ][]	gemma-3-4b-pt	unsloth	125	google/gemma-3-4b-pt	63.2
gemma-3-27b-it-qat-GGUF	medium	[BoolQ][]	gemma-3-27b-it-qat-q4-0-unquantized	unsloth	126	google/gemma-3-27b-it-qat-q4_0-unquantized	63.2
gemma-3-12b-it-qat-q4_0-gguf	medium	[BoolQ][]	gemma-3-12b-it	google	127	google/gemma-3-12b-it	63.2
gemma-3-1b-it-bnb-4bit	medium	[BoolQ][]	gemma-3-1b-it	unsloth	128	google/gemma-3-1b-it	63.2
gemma-3-1b-it-qat-q4_0-gguf	medium	[BoolQ][]	gemma-3-1b-it	google	129	google/gemma-3-1b-it	63.2
gemma-3-4b-pt-unsloth-bnb-4bit	medium	[BoolQ][]	gemma-3-4b-pt	unsloth	130	google/gemma-3-4b-pt	63.2
gemma-3-12b-it-qat	medium	[BoolQ][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	131	google/gemma-3-12b-it-qat-q4_0-unquantized	63.2
gemma-3-1b-pt-unsloth-bnb-4bit	medium	[BoolQ][]	gemma-3-1b-pt	unsloth	132	google/gemma-3-1b-pt	63.2
gemma-3-4b-it-FP8-Dynamic	medium	[BoolQ][]	gemma-3-4b-it	unsloth	133	google/gemma-3-4b-it	63.2
gemma-3-12b-pt-bnb-4bit	medium	[BoolQ][]	gemma-3-12b-pt	unsloth	134	google/gemma-3-12b-pt	63.2
gemma-3-12b-it-qat-int4-unquantized	medium	[BoolQ][]	gemma-3-12b-it	google	135	google/gemma-3-12b-it	63.2
gemma-3-27b-it-GGUF	medium	[BoolQ][]	gemma-3-27b-pt	Mungert	136	google/gemma-3-27b-pt	63.2
gemma-3-27b-it-qat-q4_0-unquantized	medium	[BoolQ][]	gemma-3-27b-it	google	137	google/gemma-3-27b-it	63.2
gemma-3-12b-pt-unsloth-bnb-4bit	medium	[BoolQ][]	gemma-3-12b-pt	unsloth	138	google/gemma-3-12b-pt	63.2
gemma-3-27b-it-qat-q4_0-gguf	medium	[BoolQ][]	gemma-3-27b-it	google	139	google/gemma-3-27b-it	63.2
gemma-3-27b-it-qat-q4_0-GGUF	medium	[BoolQ][]	gemma-3-27b-it	Mungert	140	google/gemma-3-27b-it	63.2
gemma-3-4b-it-qat-bnb-4bit	medium	[BoolQ][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	141	google/gemma-3-4b-it-qat-q4_0-unquantized	63.2
gemma-3-1b-pt-bnb-4bit	medium	[BoolQ][]	gemma-3-1b-pt	unsloth	142	google/gemma-3-1b-pt	63.2
gemma-3-27b-pt	medium	[BoolQ][]	gemma-3-27b-pt	unsloth	143	google/gemma-3-27b-pt	63.2
gemma-3-12b-it-FP8-Dynamic	medium	[BoolQ][]	gemma-3-12b-pt	unsloth	144	google/gemma-3-12b-pt	63.2
gemma-3-1b-it-qat-int4-unquantized	medium	[BoolQ][]	gemma-3-1b-it	google	145	google/gemma-3-1b-it	63.2
gemma-3-27b-pt-bnb-4bit	medium	[BoolQ][]	gemma-3-27b-pt	unsloth	146	google/gemma-3-27b-pt	63.2
gemma-3-12b-it-qat-unsloth-bnb-4bit	medium	[BoolQ][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	147	google/gemma-3-12b-it-qat-q4_0-unquantized	63.2
gemma-3-12b-pt-qat-q4_0-gguf	medium	[BoolQ][]	gemma-3-12b-pt	google	148	google/gemma-3-12b-pt	63.2
gemma-3-4b-it-qat	medium	[BoolQ][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	149	google/gemma-3-4b-it-qat-q4_0-unquantized	63.2
gemma-3-1b-it-qat-q4_0-unquantized	medium	[BoolQ][]	gemma-3-1b-it	google	150	google/gemma-3-1b-it	63.2
gemma-3-1b-it-qat	medium	[BoolQ][]	gemma-3-1b-it-qat-q4-0-unquantized	unsloth	151	google/gemma-3-1b-it-qat-q4_0-unquantized	63.2
gemma-3-27b-it-qat	medium	[BoolQ][]	gemma-3-27b-it-qat-q4-0-unquantized	unsloth	152	google/gemma-3-27b-it-qat-q4_0-unquantized	63.2
gemma-3-4b-pt-qat-q4_0-gguf	medium	[BoolQ][]	gemma-3-4b-pt	google	153	google/gemma-3-4b-pt	63.2
dolly-v2-7b-olive-optimized	low	boolq	Unknown	microsoft	154	microsoft/dolly-v2-7b-olive-optimized	62.63
vaultgemma-1b	medium	[BoolQ][]	vaultgemma-1b	google	155	google/vaultgemma-1b	62.04
gemma-3-270m	medium	[BoolQ][]	gemma-3-270m	google	156	google/gemma-3-270m	61.4
gemma-3-270m-it	medium	[BoolQ][]	gemma-3-270m	google	157	google/gemma-3-270m	61.4
gemma-3-270m-it-GGUF	medium	[BoolQ][]	gemma-3-270m-it	unsloth	158	google/gemma-3-270m-it	61.4
gemma-3-270m-it	medium	[BoolQ][]	gemma-3-270m-it	unsloth	159	google/gemma-3-270m-it	61.4
gemma-3-270m-it-unsloth-bnb-4bit	medium	[BoolQ][]	gemma-3-270m-it	unsloth	160	google/gemma-3-270m-it	61.4
gemma-3-270m-it-qat-GGUF	medium	[BoolQ][]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	161	google/gemma-3-270m-it-qat-q4_0-unquantized	61.4
gemma-3-270m	medium	[BoolQ][]	gemma-3-270m	unsloth	162	google/gemma-3-270m	61.4
gemma-3-270m-unsloth-bnb-4bit	medium	[BoolQ][]	gemma-3-270m-it	unsloth	163	google/gemma-3-270m-it	61.4
gemma-3-270m-it-qat-q4_0-unquantized	medium	[BoolQ][]	gemma-3-270m-it	google	164	google/gemma-3-270m-it	61.4
gemma-3-270m-it-bnb-4bit	medium	[BoolQ][]	gemma-3-270m-it	unsloth	165	google/gemma-3-270m-it	61.4
gemma-3-270m-it-qat	medium	[BoolQ][]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	166	google/gemma-3-270m-it-qat-q4_0-unquantized	61.4
gemma-3-270m-bnb-4bit	medium	[BoolQ][]	gemma-3-270m	unsloth	167	google/gemma-3-270m	61.4
gemma-3-270m-qat-q4_0-unquantized	medium	[BoolQ][]	gemma-3-270m	google	168	google/gemma-3-270m	61.4
gemma-3-270m-it-GGUF	medium	[BoolQ][]	gemma-3-270m	Mungert	169	google/gemma-3-270m	61.4
gemma-3-270m-it-torchao-FP8	medium	[BoolQ][]	gemma-3-270m-it	unsloth	170	google/gemma-3-270m-it	61.4
TinyLlama-1.1B-intermediate-step-715k-1.5T-GGUF	high	boolq	tinyllama-1-1b-intermediate-step-715k-1-5t	TheBloke	171	PY007/TinyLlama-1.1B-intermediate-step-715k-1.5T	59.08
TinyLlama-1.1B-intermediate-step-1431k-3T-GGUF	high	boolq	tinyllama-1-1b-intermediate-step-1431k-3t	TheBloke	172	TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T	57.83
MobileLLM-125M	low	boolq	Unknown	facebook	173	facebook/MobileLLM-125M	57.5
t5gemma-2-270m-270m	medium	[BoolQ]	t5gemma-2-270m-270m	google	174	google/t5gemma-2-270m-270m	57.4
t5gemma-2-4b-4b	medium	[BoolQ]	t5gemma-2-4b-4b	google	175	google/t5gemma-2-4b-4b	57.4
t5gemma-2-1b-1b	medium	[BoolQ]	t5gemma-2-1b-1b	google	176	google/t5gemma-2-1b-1b	57.4
Redmond-Hermes-Coder-GPTQ	medium	boolq	Unknown	TheBloke	177	—	54.98
flan-t5-base	medium	boolq	Unknown	google	178	google/flan-t5-base	16.75

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/boolq.html, docs/notes/hf-benchmark-contexts.json
url: huggingface.co/spaces/boolq ↗