Leaderboard

MGSM

mgsm

Record

Category: math
Scored models: 143

Scores

Model	Score
deepseek-ai/DeepSeek-V3-0324	92
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	87.73
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	87.47
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16	82.53
deepseek-ai/DeepSeek-V4-Flash	81.3
deepseek-ai/DeepSeek-V4-Pro	81.3
—	81.3
deepseek-ai/DeepSeek-V4-Flash	81.3
deepseek-ai/DeepSeek-V4-Flash	81.3
—	81.3
deepseek-ai/DeepSeek-V4-Pro	81.3
nvidia/Nemotron-Labs-TwoTower-30B-A3B-Base-BF16	80.8
LiquidAI/LFM2-2.6B	74.32
LiquidAI/LFM2-8B-A1B	72.4
LiquidAI/LFM2-8B-A1B	72.4
microsoft/Phi-4-mini-instruct	63.9
microsoft/Phi-4-mini-instruct	63.9
microsoft/Phi-4-mini-instruct	63.9
microsoft/Phi-4-mini-instruct	63.9
microsoft/Phi-4-mini-instruct	63.9
microsoft/Phi-4-mini-instruct	63.9
microsoft/Phi-3.5-MoE-instruct	58.7
LiquidAI/LFM2-1.2B	55.04
LiquidAI/LFM2-1.2B	55.04

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: math
id: mgsm
name: MGSM
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
DeepSeek-V3-0324-NVFP4	medium	MGSM	deepseek-v3-0324	nvidia	1	deepseek-ai/DeepSeek-V3-0324	92
NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	medium	MGSM	nvidia-nemotron-3-ultra-550b-a55b-base-bf16	nvidia	2	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	87.73
NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	medium	MGSM	nvidia-nemotron-3-super-120b-a12b-base-bf16	nvidia	3	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	87.47
NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16	medium	MGSM (8-shot, avg acc)	nvidia-nemotron-3-nano-30b-a3b-base-bf16	nvidia	4	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16	82.53
DeepSeek-V4-Flash	medium	MGSM (EM)	deepseek-v4-flash	deepseek-ai	5	deepseek-ai/DeepSeek-V4-Flash	81.3
DeepSeek-V4-Pro	medium	MGSM (EM)	deepseek-v4-pro	deepseek-ai	6	deepseek-ai/DeepSeek-V4-Pro	81.3
DeepSeek-V4-Flash-DSpark	medium	MGSM (EM)	Unknown	deepseek-ai	7	—	81.3
DeepSeek-V4-Flash-GGUF	medium	MGSM (EM)	deepseek-v4-flash	unsloth	8	deepseek-ai/DeepSeek-V4-Flash	81.3
DeepSeek-V4-Flash	medium	MGSM (EM)	deepseek-v4-flash	unsloth	9	deepseek-ai/DeepSeek-V4-Flash	81.3
DeepSeek-V4-Pro-DSpark	medium	MGSM (EM)	Unknown	deepseek-ai	10	—	81.3
DeepSeek-V4-Pro	medium	MGSM (EM)	deepseek-v4-pro	unsloth	11	deepseek-ai/DeepSeek-V4-Pro	81.3
Nemotron-Labs-TwoTower-30B-A3B-Base-BF16	medium	MGSM (8-shot, avg acc)	nemotron-labs-twotower-30b-a3b-base-bf16	nvidia	12	nvidia/Nemotron-Labs-TwoTower-30B-A3B-Base-BF16	80.8
LFM2-2.6B-GGUF	high	Unknown	lfm2-2-6b	Mungert	13	LiquidAI/LFM2-2.6B	74.32
LFM2-8B-A1B-GGUF	low	Unknown	lfm2-8b-a1b	unsloth	14	LiquidAI/LFM2-8B-A1B	72.4
LFM2-8B-A1B	low	Unknown	lfm2-8b-a1b	unsloth	15	LiquidAI/LFM2-8B-A1B	72.4
Phi-4-mini-instruct	medium	MGSM (0-shot, CoT)	phi-4-mini-instruct	microsoft	16	microsoft/Phi-4-mini-instruct	63.9
Phi-4-mini-instruct-GGUF	medium	MGSM (0-shot, CoT)	phi-4-mini-instruct	unsloth	17	microsoft/Phi-4-mini-instruct	63.9
Phi-4-mini-instruct-unsloth-bnb-4bit	medium	MGSM (0-shot, CoT)	phi-4-mini-instruct	unsloth	18	microsoft/Phi-4-mini-instruct	63.9
Phi-4-mini-instruct-bnb-4bit	medium	MGSM (0-shot, CoT)	phi-4-mini-instruct	unsloth	19	microsoft/Phi-4-mini-instruct	63.9
Phi-4-mini-instruct	medium	MGSM (0-shot, CoT)	phi-4-mini-instruct	unsloth	20	microsoft/Phi-4-mini-instruct	63.9
Phi-4-mini-instruct-GGUF	medium	MGSM (0-shot, CoT)	phi-4-mini-instruct	Mungert	21	microsoft/Phi-4-mini-instruct	63.9
Phi-3.5-MoE-instruct	medium	MGSM	phi-3-5-moe-instruct	microsoft	22	microsoft/Phi-3.5-MoE-instruct	58.7
LFM2-1.2B-GGUF	high	Unknown	lfm2-1-2b	unsloth	23	LiquidAI/LFM2-1.2B	55.04
LFM2-1.2B-unsloth-bnb-4bit	high	Unknown	lfm2-1-2b	unsloth	24	LiquidAI/LFM2-1.2B	55.04
LFM2-1.2B	high	Unknown	lfm2-1-2b	unsloth	25	LiquidAI/LFM2-1.2B	55.04
glm-4-9b-chat-hf	medium	MGSM	glm-4-9b-chat	zai-org	26	THUDM/glm-4-9b-chat	54
gemma-3n-E2B-it	medium	[MGSM][]	gemma-3n-e4b	google	27	google/gemma-3n-E4B-it	53.1
gemma-3n-E4B-it	medium	[MGSM][]	gemma-3n-e4b	google	28	google/gemma-3n-E4B	53.1
gemma-3n-E4B-it-litert-lm	medium	[MGSM][]	Unknown	google	29	google/gemma-3n-E4B-it-litert-lm	53.1
gemma-3n-E2B-it-GGUF	medium	[MGSM][]	gemma-3n-e2b-it	unsloth	30	google/gemma-3n-E2B-it	53.1
gemma-3n-E4B-it	medium	[MGSM][]	gemma-3n-e4b	unsloth	31	google/gemma-3n-E4B-it	53.1
gemma-3n-E2B	medium	[MGSM][]	gemma-3n-e4b	google	32	google/gemma-3n-E4B	53.1
gemma-3n-E2B-it-litert-lm	medium	[MGSM][]	Unknown	google	33	google/gemma-3n-E2B-it-litert-lm	53.1
gemma-3n-E4B-it-GGUF	medium	[MGSM][]	gemma-3n-e4b	unsloth	34	google/gemma-3n-E4B-it	53.1
gemma-3n-E4B	medium	[MGSM][]	gemma-3n-e4b	google	35	google/gemma-3n-E4B	53.1
gemma-3n-E2B-it-unsloth-bnb-4bit	medium	[MGSM][]	gemma-3n-e2b-it	unsloth	36	google/gemma-3n-E2B-it	53.1
gemma-3n-E2B-it-litert-preview-GGUF	medium	[MGSM][]	Unknown	unsloth	37	google/gemma-3n-E2B-it-litert-preview	53.1
gemma-3n-E4B-it-litert-preview-GGUF	medium	[MGSM][]	Unknown	unsloth	38	google/gemma-3n-E4B-it-litert-preview	53.1
gemma-3n-E4B-unsloth-bnb-4bit	medium	[MGSM][]	gemma-3n-e4b	unsloth	39	google/gemma-3n-E4B-it	53.1
gemma-3n-E2B-it-ONNX	medium	[MGSM][]	gemma-3n-e2b-it	onnx-community	40	google/gemma-3n-E2B-it	53.1
gemma-3n-E4B-it-GGUF	medium	[MGSM][]	gemma-3n-e4b	Mungert	41	google/gemma-3n-E4B	53.1
gemma-3n-E4B-it-absolute-heresy-MPOA-imatrix-GGUF	medium	[MGSM][]	gemma-3n-e4b-it-absolute-heresy-mpoa	MuXodious	42	MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA	53.1
gemma-3n-E4B-it-absolute-heresy-GGUF	medium	[MGSM][]	gemma-3n-e4b	MuXodious	43	google/gemma-3n-E4B-it	53.1
gemma-3n-E4B-it-absolute-heresy-MPOA-GGUF	medium	[MGSM][]	gemma-3n-e4b-it-absolute-heresy-mpoa	MuXodious	44	MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA	53.1
gemma-3n-E2B-it-GGUF	medium	[MGSM][]	gemma-3n-e4b	Mungert	45	google/gemma-3n-E4b-it	53.1
Phi-3.5-mini-instruct	medium	MGSM	phi-3-5-mini-instruct	microsoft	46	microsoft/Phi-3.5-mini-instruct	47.9
Phi-3.5-mini-instruct-bnb-4bit	medium	MGSM	phi-3-5-mini-instruct	unsloth	47	microsoft/Phi-3.5-mini-instruct	47.9
Phi-3.5-mini-instruct	medium	MGSM	phi-3-5-mini-instruct	unsloth	48	microsoft/Phi-3.5-mini-instruct	47.9
LFM2-700M	high	Unknown	lfm2-700m	unsloth	49	LiquidAI/LFM2-700M	45.36
LFM2-700M-GGUF	high	Unknown	lfm2-700m	unsloth	50	LiquidAI/LFM2-700M	45.36
LFM2-350M	high	Unknown	lfm2-350m	unsloth	51	LiquidAI/LFM2-350M	29.52
LFM2-350M-GGUF	high	Unknown	lfm2-350m	unsloth	52	LiquidAI/LFM2-350M	29.52
LFM2-350M-unsloth-bnb-4bit	high	Unknown	lfm2-350m	unsloth	53	LiquidAI/LFM2-350M	29.52
Swallow-70B-instruct-GGUF	high	Unknown	Unknown	TheBloke	54	tokyotech-llm/Swallow-70b-instruct-hf	12.4
Swallow-7B-Instruct-GGUF	high	Unknown	Unknown	TheBloke	55	tokyotech-llm/Swallow-7b-instruct-hf	12.4
Swallow-13B-Instruct-GGUF	high	Unknown	Unknown	TheBloke	56	tokyotech-llm/Swallow-13b-instruct-hf	12.4
Swallow-13B-GGUF	high	Unknown	Unknown	TheBloke	57	tokyotech-llm/Swallow-13b-hf	12.4
Swallow-7B-GGUF	high	Unknown	Unknown	TheBloke	58	tokyotech-llm/Swallow-7b-hf	12.4
Swallow-70B-GGUF	high	Unknown	Unknown	TheBloke	59	tokyotech-llm/Swallow-70b-hf	12.4
gemma-3-1b-it	medium	[MGSM][]	gemma-3-1b-pt	google	60	google/gemma-3-1b-pt	2.04
gemma-3-4b-it	medium	[MGSM][]	gemma-3-4b-pt	google	61	google/gemma-3-4b-pt	2.04
gemma-3-270m	medium	[MGSM][]	gemma-3-270m	google	62	google/gemma-3-270m	2.04
gemma-3-12b-it	medium	[MGSM][]	gemma-3-12b-pt	google	63	google/gemma-3-12b-pt	2.04
gemma-3-27b-it	medium	[MGSM][]	gemma-3-27b-pt	google	64	google/gemma-3-27b-pt	2.04
gemma-3-270m-it	medium	[MGSM][]	gemma-3-270m	google	65	google/gemma-3-270m	2.04
gemma-3-4b-it	medium	[MGSM][]	gemma-3-4b-pt	unsloth	66	google/gemma-3-4b-it	2.04
gemma-3-1b-it-GGUF	medium	[MGSM][]	gemma-3-1b-pt	ggml-org	67	google/gemma-3-1b-it	2.04
gemma-3-12b-it-qat-q4_0-unquantized	medium	[MGSM][]	gemma-3-12b-pt	google	68	google/gemma-3-12b-it	2.04
gemma-3-1b-it	medium	[MGSM][]	gemma-3-1b-pt	unsloth	69	google/gemma-3-1b-it	2.04
gemma-3-270m-it-GGUF	medium	[MGSM][]	gemma-3-270m-it	unsloth	70	google/gemma-3-270m-it	2.04
gemma-3-12b-it-GGUF	medium	[MGSM][]	gemma-3-12b-pt	unsloth	71	google/gemma-3-12b-it	2.04
gemma-3-4b-pt	medium	[MGSM][]	gemma-3-4b-pt	google	72	google/gemma-3-4b-pt	2.04
gemma-3-12b-it-qat-GGUF	medium	[MGSM][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	73	google/gemma-3-12b-it-qat-q4_0-unquantized	2.04
gemma-3-27b-it	medium	[MGSM][]	gemma-3-27b-it	unsloth	74	google/gemma-3-27b-it	2.04
gemma-3-1b-pt	medium	[MGSM][]	gemma-3-1b-pt	google	75	google/gemma-3-1b-pt	2.04
gemma-3-4b-it-GGUF	medium	[MGSM][]	gemma-3-4b-pt	ggml-org	76	google/gemma-3-4b-it	2.04
gemma-3-4b-it-GGUF	medium	[MGSM][]	gemma-3-4b-pt	unsloth	77	google/gemma-3-4b-it	2.04
gemma-3-1b-it-GGUF	medium	[MGSM][]	gemma-3-1b-pt	unsloth	78	google/gemma-3-1b-it	2.04
gemma-3-12b-pt	medium	[MGSM][]	Unknown	google	79	google/gemma-3-12b	2.04
gemma-3-12b-it-unsloth-bnb-4bit	medium	[MGSM][]	gemma-3-12b-pt	unsloth	80	google/gemma-3-12b-it	2.04
gemma-3-4b-it-unsloth-bnb-4bit	medium	[MGSM][]	gemma-3-4b-pt	unsloth	81	google/gemma-3-4b-it	2.04
gemma-3-12b-it	medium	[MGSM][]	gemma-3-12b-pt	unsloth	82	google/gemma-3-12b-pt	2.04
gemma-3-270m-it	medium	[MGSM][]	gemma-3-270m-it	unsloth	83	google/gemma-3-270m-it	2.04
gemma-3-27b-it-GGUF	medium	[MGSM][]	gemma-3-27b-it	unsloth	84	google/gemma-3-27b-it	2.04
gemma-3-1b-it-unsloth-bnb-4bit	medium	[MGSM][]	gemma-3-1b-pt	unsloth	85	google/gemma-3-1b-it	2.04
gemma-3-4b-it-bnb-4bit	medium	[MGSM][]	gemma-3-4b-pt	unsloth	86	google/gemma-3-4b-it	2.04
gemma-3-4b-pt	medium	[MGSM][]	gemma-3-4b-pt	unsloth	87	google/gemma-3-4b-pt	2.04
gemma-3-27b-pt	medium	[MGSM][]	gemma-3-27b-pt	google	88	google/gemma-3-27b-pt	2.04
gemma-3-12b-it-bnb-4bit	medium	[MGSM][]	gemma-3-12b-pt	unsloth	89	google/gemma-3-12b-it	2.04
gemma-3-270m-it-unsloth-bnb-4bit	medium	[MGSM][]	gemma-3-270m-it	unsloth	90	google/gemma-3-270m-it	2.04
gemma-3-27b-it-GGUF	medium	[MGSM][]	gemma-3-27b-it	ggml-org	91	google/gemma-3-27b-it	2.04
gemma-3-12b-pt	medium	[MGSM][]	gemma-3-12b-pt	unsloth	92	google/gemma-3-12b-pt	2.04
gemma-3-27b-it-bnb-4bit	medium	[MGSM][]	gemma-3-27b-it	unsloth	93	google/gemma-3-27b-it	2.04
gemma-3-27b-it-unsloth-bnb-4bit	medium	[MGSM][]	gemma-3-27b-it	unsloth	94	google/gemma-3-27b-it	2.04
gemma-3-1b-pt	medium	[MGSM][]	gemma-3-1b-pt	unsloth	95	google/gemma-3-1b-pt	2.04
gemma-3-12b-it-GGUF	medium	[MGSM][]	gemma-3-12b-pt	ggml-org	96	google/gemma-3-12b-it	2.04
gemma-3-4b-it-qat-GGUF	medium	[MGSM][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	97	google/gemma-3-4b-it-qat-q4_0-unquantized	2.04
gemma-3-270m-it-qat-GGUF	medium	[MGSM][]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	98	google/gemma-3-270m-it-qat-q4_0-unquantized	2.04
gemma-3-12b-it-qat-bnb-4bit	medium	[MGSM][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	99	google/gemma-3-12b-it-qat-q4_0-unquantized	2.04
gemma-3-270m	medium	[MGSM][]	gemma-3-270m	unsloth	100	google/gemma-3-270m	2.04
gemma-3-12b-it-qat-int4-GGUF	medium	[MGSM][]	gemma-3-12b-it-qat-int4-unquantized	unsloth	101	google/gemma-3-12b-it-qat-int4-unquantized	2.04
gemma-3-4b-it-qat-q4_0-gguf	medium	[MGSM][]	gemma-3-4b-pt	google	102	google/gemma-3-4b-it	2.04
gemma-3-4b-it-qat-q4_0-unquantized	medium	[MGSM][]	gemma-3-4b-pt	google	103	google/gemma-3-4b-it	2.04
gemma-3-4b-pt-bnb-4bit	medium	[MGSM][]	gemma-3-4b-pt	unsloth	104	google/gemma-3-4b-pt	2.04
gemma-3-27b-it-qat-GGUF	medium	[MGSM][]	gemma-3-27b-it-qat-q4-0-unquantized	unsloth	105	google/gemma-3-27b-it-qat-q4_0-unquantized	2.04
gemma-3-12b-it-qat-q4_0-gguf	medium	[MGSM][]	gemma-3-12b-pt	google	106	google/gemma-3-12b-it	2.04
gemma-3-1b-it-bnb-4bit	medium	[MGSM][]	gemma-3-1b-pt	unsloth	107	google/gemma-3-1b-it	2.04
gemma-3-1b-it-qat-q4_0-gguf	medium	[MGSM][]	gemma-3-1b-pt	google	108	google/gemma-3-1b-it	2.04
gemma-3-4b-pt-unsloth-bnb-4bit	medium	[MGSM][]	gemma-3-4b-pt	unsloth	109	google/gemma-3-4b-pt	2.04
gemma-3-270m-unsloth-bnb-4bit	medium	[MGSM][]	gemma-3-270m-it	unsloth	110	google/gemma-3-270m-it	2.04
gemma-3-12b-it-qat	medium	[MGSM][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	111	google/gemma-3-12b-it-qat-q4_0-unquantized	2.04
gemma-3-1b-pt-unsloth-bnb-4bit	medium	[MGSM][]	gemma-3-1b-pt	unsloth	112	google/gemma-3-1b-pt	2.04
gemma-3-4b-it-FP8-Dynamic	medium	[MGSM][]	gemma-3-4b-pt	unsloth	113	google/gemma-3-4b-it	2.04
gemma-3-270m-it-qat-q4_0-unquantized	medium	[MGSM][]	gemma-3-270m-it	google	114	google/gemma-3-270m-it	2.04
gemma-3-12b-pt-bnb-4bit	medium	[MGSM][]	gemma-3-12b-pt	unsloth	115	google/gemma-3-12b-pt	2.04
gemma-3-12b-it-qat-int4-unquantized	medium	[MGSM][]	gemma-3-12b-pt	google	116	google/gemma-3-12b-it	2.04
gemma-3-27b-it-GGUF	medium	[MGSM][]	gemma-3-27b-pt	Mungert	117	google/gemma-3-27b-pt	2.04
gemma-3-27b-it-qat-q4_0-unquantized	medium	[MGSM][]	gemma-3-27b-it	google	118	google/gemma-3-27b-it	2.04
gemma-3-12b-pt-unsloth-bnb-4bit	medium	[MGSM][]	gemma-3-12b-pt	unsloth	119	google/gemma-3-12b-pt	2.04
gemma-3-270m-it-bnb-4bit	medium	[MGSM][]	gemma-3-270m-it	unsloth	120	google/gemma-3-270m-it	2.04
gemma-3-27b-it-qat-q4_0-gguf	medium	[MGSM][]	gemma-3-27b-it	google	121	google/gemma-3-27b-it	2.04
gemma-3-27b-it-qat-q4_0-GGUF	medium	[MGSM][]	gemma-3-27b-it	Mungert	122	google/gemma-3-27b-it	2.04
gemma-3-270m-it-qat	medium	[MGSM][]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	123	google/gemma-3-270m-it-qat-q4_0-unquantized	2.04
gemma-3-4b-it-qat-bnb-4bit	medium	[MGSM][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	124	google/gemma-3-4b-it-qat-q4_0-unquantized	2.04
gemma-3-1b-pt-bnb-4bit	medium	[MGSM][]	gemma-3-1b-pt	unsloth	125	google/gemma-3-1b-pt	2.04
gemma-3-27b-pt	medium	[MGSM][]	gemma-3-27b-pt	unsloth	126	google/gemma-3-27b-pt	2.04
gemma-3-12b-it-FP8-Dynamic	medium	[MGSM][]	gemma-3-12b-pt	unsloth	127	google/gemma-3-12b-pt	2.04
gemma-3-270m-bnb-4bit	medium	[MGSM][]	gemma-3-270m	unsloth	128	google/gemma-3-270m	2.04
gemma-3-1b-it-qat-int4-unquantized	medium	[MGSM][]	gemma-3-1b-pt	google	129	google/gemma-3-1b-it	2.04
gemma-3-27b-pt-bnb-4bit	medium	[MGSM][]	gemma-3-27b-pt	unsloth	130	google/gemma-3-27b-pt	2.04
gemma-3-12b-it-qat-unsloth-bnb-4bit	medium	[MGSM][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	131	google/gemma-3-12b-it-qat-q4_0-unquantized	2.04
gemma-3-270m-qat-q4_0-unquantized	medium	[MGSM][]	gemma-3-270m	google	132	google/gemma-3-270m	2.04
gemma-3-12b-pt-qat-q4_0-gguf	medium	[MGSM][]	gemma-3-12b-pt	google	133	google/gemma-3-12b-pt	2.04
gemma-3-270m-it-GGUF	medium	[MGSM][]	gemma-3-270m	Mungert	134	google/gemma-3-270m	2.04
gemma-3-4b-it-qat	medium	[MGSM][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	135	google/gemma-3-4b-it-qat-q4_0-unquantized	2.04
gemma-3-270m-it-torchao-FP8	medium	[MGSM][]	gemma-3-270m-it	unsloth	136	google/gemma-3-270m-it	2.04
gemma-3-1b-it-qat-q4_0-unquantized	medium	[MGSM][]	gemma-3-1b-pt	google	137	google/gemma-3-1b-it	2.04
gemma-3-1b-it-qat	medium	[MGSM][]	gemma-3-1b-it-qat-q4-0-unquantized	unsloth	138	google/gemma-3-1b-it-qat-q4_0-unquantized	2.04
gemma-3-27b-it-qat	medium	[MGSM][]	gemma-3-27b-it-qat-q4-0-unquantized	unsloth	139	google/gemma-3-27b-it-qat-q4_0-unquantized	2.04
gemma-3-4b-pt-qat-q4_0-gguf	medium	[MGSM][]	gemma-3-4b-pt	google	140	google/gemma-3-4b-pt	2.04
t5gemma-2-270m-270m	medium	[MGSM]	t5gemma-2-270m-270m	google	141	google/t5gemma-2-270m-270m	1.8
t5gemma-2-4b-4b	medium	[MGSM]	t5gemma-2-4b-4b	google	142	google/t5gemma-2-4b-4b	1.8
t5gemma-2-1b-1b	medium	[MGSM]	t5gemma-2-1b-1b	google	143	google/t5gemma-2-1b-1b	1.8

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/mgsm.html
url: huggingface.co/spaces/mgsm ↗