Leaderboard

CommonsenseQA

commonsenseqa

Record

Category: knowledge
Scored models: 39

Scores

Model	Score
nvidia/Nemotron-H-56B-Base-8K	87.3
nvidia/Nemotron-H-56B-Base-8K	86.73
lightblue/openorca_stx	83.1
microsoft/Phi-3-medium-4k-instruct	82.8
microsoft/Phi-3-medium-128k-instruct	82.2
microsoft/GRIN-MoE	81.8
microsoft/Phi-3-small-128k-instruct	80.8
microsoft/Phi-3-small-8k-instruct	80
nvidia/Nemotron-H-8B-Base-8K	78.71
internlm/internlm-chat-7b	75.2
internlm/internlm-7b	75.2
mistralai/Mistral-Nemo-Base-2407	70.4
mistralai/Mistral-Nemo-Base-2407	70.4
mistralai/Mistral-Nemo-Base-2407	70.4
nvidia/Nemotron-H-4B-Base-8K	70.2
google/gemma-1.1-2b-it	65.3
google/gemma-2b-it-pytorch	65.3
google/gemma-2b-it-pytorch	65.3
google/gemma-7b-it-quant-pytorch	65.3
google/gemma-7b	65.3
google/gemma-1.1-7b-it	65.3
google/gemma-2b-it-pytorch	65.3
google/gemma-7b-it-quant-pytorch	65.3
google/gemma-2b-it-pytorch	65.3

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: knowledge
id: commonsenseqa
name: CommonsenseQA
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
Nemotron-H-47B-Base-8K	low	Unknown	nemotron-h-56b-base-8k	nvidia	1	nvidia/Nemotron-H-56B-Base-8K	87.3
Nemotron-H-56B-Base-8K	low	Unknown	nemotron-h-56b-base-8k	nvidia	2	nvidia/Nemotron-H-56B-Base-8K	86.73
OpenOrca_Stx-GGUF	medium	j-1.1-0.3	Unknown	TheBloke	3	lightblue/openorca_stx	83.1
Phi-3-medium-4k-instruct	medium	CommonsenseQA<br>10-shot	phi-3-medium-4k-instruct	microsoft	4	microsoft/Phi-3-medium-4k-instruct	82.8
Phi-3-medium-128k-instruct	medium	CommonsenseQA<br>10-shot	phi-3-medium-128k-instruct	microsoft	5	microsoft/Phi-3-medium-128k-instruct	82.2
GRIN-MoE	medium	CommonSenseQA	grin-moe	microsoft	6	microsoft/GRIN-MoE	81.8
Phi-3-small-128k-instruct	medium	CommonsenseQA<br>10-shot	phi-3-small-128k-instruct	microsoft	7	microsoft/Phi-3-small-128k-instruct	80.8
Phi-3-small-8k-instruct	medium	CommonsenseQA<br>10-shot	phi-3-small-8k-instruct	microsoft	8	microsoft/Phi-3-small-8k-instruct	80
Nemotron-H-8B-Base-8K	low	Unknown	nemotron-h-8b-base-8k	nvidia	9	nvidia/Nemotron-H-8B-Base-8K	78.71
internlm-chat-7b	medium	CommonSenseQA	Unknown	internlm	10	internlm/internlm-chat-7b	75.2
internlm-7b	medium	CommonSenseQA	Unknown	internlm	11	internlm/internlm-7b	75.2
Mistral-Nemo-Instruct-2407	medium	CommonSenseQA (0-shot)	mistral-nemo-base-2407	mistralai	12	mistralai/Mistral-Nemo-Base-2407	70.4
Mistral-Nemo-Base-2407	medium	CommonSenseQA (0-shot)	mistral-nemo-base-2407	mistralai	13	mistralai/Mistral-Nemo-Base-2407	70.4
Mistral-Nemo-Instruct-FP8-2407	medium	CommonSenseQA (0-shot)	mistral-nemo-base-2407	mistralai	14	mistralai/Mistral-Nemo-Base-2407	70.4
Nemotron-H-4B-Base-8K	low	Unknown	nemotron-h-4b-base-8k	nvidia	15	nvidia/Nemotron-H-4B-Base-8K	70.2
gemma-1.1-2b-it	medium	[CommonsenseQA](https://arxiv.org/abs/1811.00937)	gemma-1-1-2b-it	google	16	google/gemma-1.1-2b-it	65.3
gemma-2b	medium	[CommonsenseQA](https://arxiv.org/abs/1811.00937)	Unknown	google	17	google/gemma-2b-it-pytorch	65.3
gemma-2b-it	medium	[CommonsenseQA](https://arxiv.org/abs/1811.00937)	Unknown	google	18	google/gemma-2b-it-pytorch	65.3
gemma-7b	medium	[CommonsenseQA](https://arxiv.org/abs/1811.00937)	Unknown	google	19	google/gemma-7b-it-quant-pytorch	65.3
gemma-7b-it	medium	[CommonsenseQA](https://arxiv.org/abs/1811.00937)	gemma-7b	google	20	google/gemma-7b	65.3
gemma-1.1-7b-it	medium	[CommonsenseQA](https://arxiv.org/abs/1811.00937)	gemma-1-1-7b-it	google	21	google/gemma-1.1-7b-it	65.3
gemma-2b-AWQ	medium	[CommonsenseQA](https://arxiv.org/abs/1811.00937)	Unknown	google	22	google/gemma-2b-it-pytorch	65.3
gemma-7b	medium	[CommonsenseQA](https://arxiv.org/abs/1811.00937)	Unknown	alpindale	23	google/gemma-7b-it-quant-pytorch	65.3
gemma-2b	medium	[CommonsenseQA](https://arxiv.org/abs/1811.00937)	Unknown	alpindale	24	google/gemma-2b-it-pytorch	65.3
gemma-7b-AWQ	medium	[CommonsenseQA](https://arxiv.org/abs/1811.00937)	Unknown	google	25	google/gemma-7b-it-quant-pytorch	65.3
gemma-7b-it	medium	[CommonsenseQA](https://arxiv.org/abs/1811.00937)	Unknown	alpindale	26	google/gemma-7b-it-quant-pytorch	65.3
gemma-7b-GGUF	medium	[CommonsenseQA](https://arxiv.org/abs/1811.00937)	Unknown	google	27	google/gemma-7b-it-quant-pytorch	65.3
bitnet-b1.58-2B-4T-gguf	medium	CommonsenseQA	bitnet-b1-58-2b-4t-bf16	microsoft	28	microsoft/bitnet-b1.58-2B-4T-bf16	58.48
bitnet-b1.58-2B-4T	medium	CommonsenseQA	bitnet-b1-58-2b-4t	microsoft	29	microsoft/bitnet-b1.58-2B-4T	58.48
bitnet-b1.58-2B-4T-bf16	medium	CommonsenseQA	bitnet-b1-58-2b-4t-bf16	microsoft	30	microsoft/bitnet-b1.58-2B-4T-bf16	58.48
Swallow-70B-instruct-GGUF	high	Unknown	Unknown	TheBloke	31	tokyotech-llm/Swallow-70b-instruct-hf	48.08
Swallow-7B-Instruct-GGUF	high	Unknown	Unknown	TheBloke	32	tokyotech-llm/Swallow-7b-instruct-hf	48.08
Swallow-13B-Instruct-GGUF	high	Unknown	Unknown	TheBloke	33	tokyotech-llm/Swallow-13b-instruct-hf	48.08
Swallow-13B-GGUF	high	Unknown	Unknown	TheBloke	34	tokyotech-llm/Swallow-13b-hf	48.08
Swallow-7B-GGUF	high	Unknown	Unknown	TheBloke	35	tokyotech-llm/Swallow-7b-hf	48.08
Swallow-70B-GGUF	high	Unknown	Unknown	TheBloke	36	tokyotech-llm/Swallow-70b-hf	48.08
SmolLM2-1.7B-Instruct-GGUF	medium	CommonsenseQA	smollm2-1-7b	Mungert	37	HuggingFaceTB/SmolLM2-1.7B	43.6
SmolLM2-360M-Instruct-GGUF	medium	CommonsenseQA	smollm2-360m	Mungert	38	HuggingFaceTB/SmolLM2-360M	38
SmolLM2-135M-Instruct-GGUF	medium	CommonsenseQA	smollm2-135m	Mungert	39	HuggingFaceTB/SmolLM2-135M	33.9

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/commonsenseqa.html
url: huggingface.co/spaces/commonsenseqa ↗