Leaderboard

DROP

drop

Record

Category: reasoning
Scored models: 190

Scores

Model	Score
MiniMaxAI/MiniMax-Text-01-hf	89.2
MiniMaxAI/MiniMax-Text-01	89.2
inclusionAI/LLaDA2.0-flash-preview	88.32
deepseek-ai/DeepSeek-V4-Flash	88.2
deepseek-ai/DeepSeek-V4-Pro	88.2
—	88.2
deepseek-ai/DeepSeek-V4-Flash	88.2
deepseek-ai/DeepSeek-V4-Flash	88.2
—	88.2
deepseek-ai/DeepSeek-V4-Pro	88.2
inclusionAI/LLaDA2.0-flash	87.57
allenai/Olmo-3-1125-32B	86.6
inclusionAI/LLaDA2.0-mini	84.56
perplexity-ai/r1-1776-distill-llama-70b	84.55
inclusionAI/LLaDA2.0-mini-preview	78.8
allenai/OLMo-2-0425-1B	70.2
allenai/OLMo-2-0325-32B-DPO	70.2
allenai/OLMo-2-0325-32B-Instruct	70.2
allenai/OLMo-2-0325-32B	70.2
allenai/OLMo-2-0325-32B-SFT	70.2
allenai/OLMo-2-0325-32B-Instruct	70.2
allenai/Olmo-3-1025-7B	63.7
allenai/Olmo-Hybrid-7B	63.7
allenai/Olmo-3-1025-7B	63.7

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: reasoning
id: drop
name: DROP
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
MiniMax-Text-01-hf	medium	DROP<sup>*</sup> _(F1)_	minimax-text-01-hf	MiniMaxAI	1	MiniMaxAI/MiniMax-Text-01-hf	89.2
MiniMax-Text-01	medium	DROP<sup>*</sup> _(F1)_	minimax-text-01	MiniMaxAI	2	MiniMaxAI/MiniMax-Text-01	89.2
LLaDA2.0-flash-preview	medium	Unknown	llada2-0-flash-preview	inclusionAI	3	inclusionAI/LLaDA2.0-flash-preview	88.32
DeepSeek-V4-Flash	medium	DROP (F1)	deepseek-v4-flash	deepseek-ai	4	deepseek-ai/DeepSeek-V4-Flash	88.2
DeepSeek-V4-Pro	medium	DROP (F1)	deepseek-v4-pro	deepseek-ai	5	deepseek-ai/DeepSeek-V4-Pro	88.2
DeepSeek-V4-Flash-DSpark	medium	DROP (F1)	Unknown	deepseek-ai	6	—	88.2
DeepSeek-V4-Flash-GGUF	medium	DROP (F1)	deepseek-v4-flash	unsloth	7	deepseek-ai/DeepSeek-V4-Flash	88.2
DeepSeek-V4-Flash	medium	DROP (F1)	deepseek-v4-flash	unsloth	8	deepseek-ai/DeepSeek-V4-Flash	88.2
DeepSeek-V4-Pro-DSpark	medium	DROP (F1)	Unknown	deepseek-ai	9	—	88.2
DeepSeek-V4-Pro	medium	DROP (F1)	deepseek-v4-pro	unsloth	10	deepseek-ai/DeepSeek-V4-Pro	88.2
LLaDA2.0-flash	medium	DROP	llada2-0-flash	inclusionAI	11	inclusionAI/LLaDA2.0-flash	87.57
Olmo-3-1125-32B	low	Unknown	olmo-3-1125-32b	allenai	12	allenai/Olmo-3-1125-32B	86.6
LLaDA2.0-mini	medium	DROP	llada2-0-mini	inclusionAI	13	inclusionAI/LLaDA2.0-mini	84.56
r1-1776-distill-llama-70b-GGUF	medium	DROP	Unknown	unsloth	14	perplexity-ai/r1-1776-distill-llama-70b	84.55
LLaDA2.0-mini-preview	medium	Unknown	llada2-0-mini-preview	inclusionAI	15	inclusionAI/LLaDA2.0-mini-preview	78.8
OLMo-2-0425-1B	low	Unknown	olmo-2-0425-1b	allenai	16	allenai/OLMo-2-0425-1B	70.2
OLMo-2-0325-32B-Instruct	low	Unknown	Unknown	allenai	17	allenai/OLMo-2-0325-32B-DPO	70.2
OLMo-2-0325-32B-Instruct-GGUF	low	Unknown	olmo-2-0325-32b-instruct	unsloth	18	allenai/OLMo-2-0325-32B-Instruct	70.2
OLMo-2-0325-32B-SFT	low	Unknown	olmo-2-0325-32b	allenai	19	allenai/OLMo-2-0325-32B	70.2
OLMo-2-0325-32B-DPO	low	Unknown	Unknown	allenai	20	allenai/OLMo-2-0325-32B-SFT	70.2
OLMo-2-0325-32B-Instruct	low	Unknown	olmo-2-0325-32b-instruct	unsloth	21	allenai/OLMo-2-0325-32B-Instruct	70.2
Olmo-3-1025-7B	low	Unknown	olmo-3-1025-7b	allenai	22	allenai/Olmo-3-1025-7B	63.7
Olmo-Hybrid-7B	low	Unknown	olmo-hybrid-7b	allenai	23	allenai/Olmo-Hybrid-7B	63.7
Olmo-3-1025-7B-GGUF	low	Unknown	olmo-3-1025-7b	Mungert	24	allenai/Olmo-3-1025-7B	63.7
Llama-3.1-Tulu-3-8B-SFT	medium	DROP (3 shot)	llama-3-1-8b	allenai	25	meta-llama/Llama-3.1-8B	61.3
Llama-3.1-Tulu-3-8B	medium	DROP (3 shot)	llama-3-1-tulu-3-8b-dpo	allenai	26	allenai/Llama-3.1-Tulu-3-8B-DPO	61.3
Llama-3.1-Tulu-3-8B-DPO	medium	DROP (3 shot)	llama-3-1-tulu-3-8b-sft	allenai	27	allenai/Llama-3.1-Tulu-3-8B-SFT	61.3
Llama-3.1-Tulu-3-8B-RM	medium	DROP (3 shot)	llama-3-1-tulu-3-8b-sft	allenai	28	allenai/Llama-3.1-Tulu-3-8B-SFT	61.3
Llama-3.1-Tulu-3.1-8B	medium	DROP (3 shot)	llama-3-1-tulu-3-8b-dpo	allenai	29	allenai/Llama-3.1-Tulu-3-8B-DPO	61.3
Llama-3.1-Tulu-3-70B	medium	DROP (3 shot)	llama-3-1-tulu-3-70b-dpo	allenai	30	allenai/Llama-3.1-Tulu-3-70B-DPO	61.3
Llama-3.1-Tulu-3-70B-SFT	medium	DROP (3 shot)	llama-3-1-70b	allenai	31	meta-llama/Llama-3.1-70B	61.3
Llama-3.1-Tulu-3-405B	medium	DROP (3 shot)	Unknown	allenai	32	allenai/Llama-3.1-Tulu-3-405B-DPO	61.3
Llama-3.1-Tulu-3-70B-DPO	medium	DROP (3 shot)	llama-3-1-tulu-3-70b-sft	allenai	33	allenai/Llama-3.1-Tulu-3-70B-SFT	61.3
Llama-3.1-Tulu-3-8B-GGUF	medium	DROP (3 shot)	llama-3-1-tulu-3-8b	unsloth	34	allenai/Llama-3.1-Tulu-3-8B	61.3
Llama-3.1-Tulu-3-405B-SFT	medium	DROP (3 shot)	llama-3-1-405b	allenai	35	meta-llama/Llama-3.1-405B	61.3
Llama-3.1-Tulu-3-70B-GGUF	medium	DROP (3 shot)	llama-3-1-tulu-3-70b	unsloth	36	allenai/Llama-3.1-Tulu-3-70B	61.3
Llama-3.1-Tulu-3-405B-DPO	medium	DROP (3 shot)	Unknown	allenai	37	allenai/Llama-3.1-Tulu-3-405B-SFT	61.3
OLMo-2-1124-7B-Instruct	low	Unknown	Unknown	allenai	38	allenai/OLMo-2-1124-7B-DPO	58.8
OLMo-2-1124-13B-Instruct	low	Unknown	olmo-2-1124-13b-instruct-rlvr2	allenai	39	allenai/OLMo-2-1124-13B-Instruct-RLVR2	58.8
OLMo-2-1124-7B-SFT	low	Unknown	olmo2-7b-1124	allenai	40	allenai/OLMo2-7B-1124	58.8
OLMo-2-1124-7B-DPO	low	Unknown	Unknown	allenai	41	allenai/OLMo-2-1124-7B-SFT	58.8
OLMo-2-1124-13B-SFT	low	Unknown	olmo2-13b-1124	allenai	42	allenai/OLMo2-13B-1124	58.8
OLMo-2-1124-13B-DPO	low	Unknown	Unknown	allenai	43	allenai/OLMo-2-1124-13B-SFT	58.8
OLMo-2-1124-7B-Instruct-preview	low	Unknown	Unknown	allenai	44	allenai/OLMo-2-1124-7B-DPO	58.8
OLMo-2-1124-7B-RM	low	Unknown	Unknown	allenai	45	allenai/OLMo-2-1124-7B-SFT	58.8
OLMo-2-1124-7B-RM-Preview	low	Unknown	Unknown	allenai	46	allenai/OLMo-2-1124-7B-SFT	58.8
OLMo-2-1124-13B-RM	low	Unknown	Unknown	allenai	47	allenai/OLMo-2-1124-13B-SFT	58.8
OLMo-2-1124-13B-Instruct-preview	low	Unknown	olmo-2-1124-13b-dpo	allenai	48	allenai/OLMo-2-1124-13B-DPO	58.8
OLMo-2-1124-7B-SFT-Preview	low	Unknown	olmo2-7b-1124	allenai	49	allenai/OLMo2-7B-1124	58.8
OLMo-2-1124-7B-DPO-Preview	low	Unknown	Unknown	allenai	50	allenai/OLMo-2-1124-7B-SFT	58.8
gemma-3n-E2B-it	medium	[DROP][]	gemma-3n-e4b	google	51	google/gemma-3n-E4B-it	53.9
gemma-3n-E4B-it	medium	[DROP][]	gemma-3n-e4b	google	52	google/gemma-3n-E4B	53.9
gemma-3n-E4B-it-litert-lm	medium	[DROP][]	Unknown	google	53	google/gemma-3n-E4B-it-litert-lm	53.9
gemma-3n-E2B-it-GGUF	medium	[DROP][]	gemma-3n-e2b-it	unsloth	54	google/gemma-3n-E2B-it	53.9
gemma-3n-E4B-it	medium	[DROP][]	gemma-3n-e4b	unsloth	55	google/gemma-3n-E4B-it	53.9
gemma-3n-E2B	medium	[DROP][]	gemma-3n-e4b	google	56	google/gemma-3n-E4B	53.9
gemma-3n-E2B-it-litert-lm	medium	[DROP][]	Unknown	google	57	google/gemma-3n-E2B-it-litert-lm	53.9
gemma-3n-E4B-it-GGUF	medium	[DROP][]	gemma-3n-e4b	unsloth	58	google/gemma-3n-E4B-it	53.9
gemma-3n-E4B	medium	[DROP][]	gemma-3n-e4b	google	59	google/gemma-3n-E4B	53.9
gemma-3n-E2B-it-unsloth-bnb-4bit	medium	[DROP][]	gemma-3n-e2b-it	unsloth	60	google/gemma-3n-E2B-it	53.9
gemma-3n-E2B-it-litert-preview-GGUF	medium	[DROP][]	Unknown	unsloth	61	google/gemma-3n-E2B-it-litert-preview	53.9
gemma-3n-E4B-it-litert-preview-GGUF	medium	[DROP][]	Unknown	unsloth	62	google/gemma-3n-E4B-it-litert-preview	53.9
gemma-3n-E4B-unsloth-bnb-4bit	medium	[DROP][]	gemma-3n-e4b	unsloth	63	google/gemma-3n-E4B-it	53.9
gemma-3n-E2B-it-ONNX	medium	[DROP][]	gemma-3n-e2b-it	onnx-community	64	google/gemma-3n-E2B-it	53.9
gemma-3n-E4B-it-GGUF	medium	[DROP][]	gemma-3n-e4b	Mungert	65	google/gemma-3n-E4B	53.9
gemma-3n-E4B-it-absolute-heresy-MPOA-imatrix-GGUF	medium	[DROP][]	gemma-3n-e4b-it-absolute-heresy-mpoa	MuXodious	66	MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA	53.9
gemma-3n-E4B-it-absolute-heresy-GGUF	medium	[DROP][]	gemma-3n-e4b	MuXodious	67	google/gemma-3n-E4B-it	53.9
gemma-3n-E4B-it-absolute-heresy-MPOA-GGUF	medium	[DROP][]	gemma-3n-e4b-it-absolute-heresy-mpoa	MuXodious	68	MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA	53.9
gemma-3n-E2B-it-GGUF	medium	[DROP][]	gemma-3n-e4b	Mungert	69	google/gemma-3n-E4b-it	53.9
gemma-2-2b-it	medium	[DROP][]	gemma-2-2b	google	70	google/gemma-2-2b	52
gemma-2-2b	medium	[DROP][]	gemma-2-2b	google	71	google/gemma-2-2b	52
OLMoE-1B-7B-0125-Instruct	medium	DROP	olmoe-1b-7b-0125-dpo	allenai	72	allenai/OLMoE-1B-7B-0125-DPO	47.87
OLMoE-1B-7B-0125-DPO	medium	DROP	Unknown	allenai	73	allenai/OLMoE-1B-7B-0125-SFT	47.87
OLMoE-1B-7B-0125-SFT	medium	DROP	olmoe-1b-7b-0125	allenai	74	allenai/OLMoE-1B-7B-0125	47.87
Synatra-7B-v0.3-RP-GGUF	medium	DROP (3-shot)	Unknown	TheBloke	75	maywell/Synatra-7B-v0.3-RP	46.06
OLMo-2-1124-7B	low	Unknown	olmo-2-1124-7b	allenai	76	allenai/OLMo-2-1124-7B	45.6
OLMo-2-1124-13B	low	Unknown	olmo-2-1124-13b	allenai	77	allenai/OLMo-2-1124-13B	45.6
OLMo-2-0325-32B	low	Unknown	olmo-2-0325-32b	allenai	78	allenai/OLMo-2-0325-32B	45.6
MLewd-v2.4-13B-GGUF	medium	DROP (3-shot)	Unknown	TheBloke	79	Undi95/MLewd-v2.4-13B	44.33
speechless-mistral-7B-dare-0.85-GGUF	low	Unknown	speechless-mistral-7b-dare-0-85	TheBloke	80	speechlessai/speechless-mistral-7b-dare-0.85	43.84
SynthIA-7B-v1.3-dare-0.85-GGUF	low	Unknown	Unknown	TheBloke	81	uukuguy/SynthIA-7B-v1.3-dare-0.85	43.84
airoboros-m-7B-3.1.2-dare-0.85-GGUF	low	Unknown	Unknown	TheBloke	82	uukuguy/airoboros-m-7b-3.1.2-dare-0.85	43.84
CollectiveCognition-v1.1-Mistral-7B-dare-0.85-GGUF	low	Unknown	Unknown	TheBloke	83	uukuguy/CollectiveCognition-v1.1-Mistral-7B-dare-0.85	43.84
gemma-3-1b-it	medium	[DROP][]	gemma-3-1b-pt	google	84	google/gemma-3-1b-pt	42.4
gemma-3-4b-it	medium	[DROP][]	gemma-3-4b-pt	google	85	google/gemma-3-4b-pt	42.4
gemma-3-270m	medium	[DROP][]	gemma-3-270m	google	86	google/gemma-3-270m	42.4
gemma-3-12b-it	medium	[DROP][]	gemma-3-12b-pt	google	87	google/gemma-3-12b-pt	42.4
gemma-3-27b-it	medium	[DROP][]	gemma-3-27b-pt	google	88	google/gemma-3-27b-pt	42.4
gemma-3-270m-it	medium	[DROP][]	gemma-3-270m	google	89	google/gemma-3-270m	42.4
gemma-3-4b-it	medium	[DROP][]	gemma-3-4b-pt	unsloth	90	google/gemma-3-4b-it	42.4
gemma-3-1b-it-GGUF	medium	[DROP][]	gemma-3-1b-pt	ggml-org	91	google/gemma-3-1b-it	42.4
gemma-3-12b-it-qat-q4_0-unquantized	medium	[DROP][]	gemma-3-12b-pt	google	92	google/gemma-3-12b-it	42.4
gemma-3-1b-it	medium	[DROP][]	gemma-3-1b-pt	unsloth	93	google/gemma-3-1b-it	42.4
gemma-3-270m-it-GGUF	medium	[DROP][]	gemma-3-270m-it	unsloth	94	google/gemma-3-270m-it	42.4
gemma-3-12b-it-GGUF	medium	[DROP][]	gemma-3-12b-pt	unsloth	95	google/gemma-3-12b-it	42.4
gemma-3-4b-pt	medium	[DROP][]	gemma-3-4b-pt	google	96	google/gemma-3-4b-pt	42.4
gemma-3-12b-it-qat-GGUF	medium	[DROP][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	97	google/gemma-3-12b-it-qat-q4_0-unquantized	42.4
gemma-3-27b-it	medium	[DROP][]	gemma-3-27b-it	unsloth	98	google/gemma-3-27b-it	42.4
gemma-3-1b-pt	medium	[DROP][]	gemma-3-1b-pt	google	99	google/gemma-3-1b-pt	42.4
gemma-3-4b-it-GGUF	medium	[DROP][]	gemma-3-4b-pt	ggml-org	100	google/gemma-3-4b-it	42.4
gemma-3-4b-it-GGUF	medium	[DROP][]	gemma-3-4b-pt	unsloth	101	google/gemma-3-4b-it	42.4
gemma-3-1b-it-GGUF	medium	[DROP][]	gemma-3-1b-pt	unsloth	102	google/gemma-3-1b-it	42.4
gemma-3-12b-pt	medium	[DROP][]	Unknown	google	103	google/gemma-3-12b	42.4
gemma-3-12b-it-unsloth-bnb-4bit	medium	[DROP][]	gemma-3-12b-pt	unsloth	104	google/gemma-3-12b-it	42.4
gemma-3-4b-it-unsloth-bnb-4bit	medium	[DROP][]	gemma-3-4b-pt	unsloth	105	google/gemma-3-4b-it	42.4
gemma-3-12b-it	medium	[DROP][]	gemma-3-12b-pt	unsloth	106	google/gemma-3-12b-pt	42.4
gemma-3-270m-it	medium	[DROP][]	gemma-3-270m-it	unsloth	107	google/gemma-3-270m-it	42.4
gemma-3-27b-it-GGUF	medium	[DROP][]	gemma-3-27b-it	unsloth	108	google/gemma-3-27b-it	42.4
gemma-3-1b-it-unsloth-bnb-4bit	medium	[DROP][]	gemma-3-1b-pt	unsloth	109	google/gemma-3-1b-it	42.4
gemma-3-4b-it-bnb-4bit	medium	[DROP][]	gemma-3-4b-pt	unsloth	110	google/gemma-3-4b-it	42.4
gemma-3-4b-pt	medium	[DROP][]	gemma-3-4b-pt	unsloth	111	google/gemma-3-4b-pt	42.4
gemma-3-27b-pt	medium	[DROP][]	gemma-3-27b-pt	google	112	google/gemma-3-27b-pt	42.4
gemma-3-12b-it-bnb-4bit	medium	[DROP][]	gemma-3-12b-pt	unsloth	113	google/gemma-3-12b-it	42.4
gemma-3-270m-it-unsloth-bnb-4bit	medium	[DROP][]	gemma-3-270m-it	unsloth	114	google/gemma-3-270m-it	42.4
gemma-3-27b-it-GGUF	medium	[DROP][]	gemma-3-27b-it	ggml-org	115	google/gemma-3-27b-it	42.4
gemma-3-12b-pt	medium	[DROP][]	gemma-3-12b-pt	unsloth	116	google/gemma-3-12b-pt	42.4
gemma-3-27b-it-bnb-4bit	medium	[DROP][]	gemma-3-27b-it	unsloth	117	google/gemma-3-27b-it	42.4
gemma-3-27b-it-unsloth-bnb-4bit	medium	[DROP][]	gemma-3-27b-it	unsloth	118	google/gemma-3-27b-it	42.4
gemma-3-1b-pt	medium	[DROP][]	gemma-3-1b-pt	unsloth	119	google/gemma-3-1b-pt	42.4
gemma-3-12b-it-GGUF	medium	[DROP][]	gemma-3-12b-pt	ggml-org	120	google/gemma-3-12b-it	42.4
gemma-3-4b-it-qat-GGUF	medium	[DROP][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	121	google/gemma-3-4b-it-qat-q4_0-unquantized	42.4
gemma-3-270m-it-qat-GGUF	medium	[DROP][]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	122	google/gemma-3-270m-it-qat-q4_0-unquantized	42.4
gemma-3-12b-it-qat-bnb-4bit	medium	[DROP][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	123	google/gemma-3-12b-it-qat-q4_0-unquantized	42.4
gemma-3-270m	medium	[DROP][]	gemma-3-270m	unsloth	124	google/gemma-3-270m	42.4
gemma-3-12b-it-qat-int4-GGUF	medium	[DROP][]	gemma-3-12b-it-qat-int4-unquantized	unsloth	125	google/gemma-3-12b-it-qat-int4-unquantized	42.4
gemma-3-4b-it-qat-q4_0-gguf	medium	[DROP][]	gemma-3-4b-pt	google	126	google/gemma-3-4b-it	42.4
gemma-3-4b-it-qat-q4_0-unquantized	medium	[DROP][]	gemma-3-4b-pt	google	127	google/gemma-3-4b-it	42.4
gemma-3-4b-pt-bnb-4bit	medium	[DROP][]	gemma-3-4b-pt	unsloth	128	google/gemma-3-4b-pt	42.4
gemma-3-27b-it-qat-GGUF	medium	[DROP][]	gemma-3-27b-it-qat-q4-0-unquantized	unsloth	129	google/gemma-3-27b-it-qat-q4_0-unquantized	42.4
gemma-3-12b-it-qat-q4_0-gguf	medium	[DROP][]	gemma-3-12b-pt	google	130	google/gemma-3-12b-it	42.4
gemma-3-1b-it-bnb-4bit	medium	[DROP][]	gemma-3-1b-pt	unsloth	131	google/gemma-3-1b-it	42.4
gemma-3-1b-it-qat-q4_0-gguf	medium	[DROP][]	gemma-3-1b-pt	google	132	google/gemma-3-1b-it	42.4
gemma-3-4b-pt-unsloth-bnb-4bit	medium	[DROP][]	gemma-3-4b-pt	unsloth	133	google/gemma-3-4b-pt	42.4
gemma-3-270m-unsloth-bnb-4bit	medium	[DROP][]	gemma-3-270m-it	unsloth	134	google/gemma-3-270m-it	42.4
gemma-3-12b-it-qat	medium	[DROP][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	135	google/gemma-3-12b-it-qat-q4_0-unquantized	42.4
gemma-3-1b-pt-unsloth-bnb-4bit	medium	[DROP][]	gemma-3-1b-pt	unsloth	136	google/gemma-3-1b-pt	42.4
gemma-3-4b-it-FP8-Dynamic	medium	[DROP][]	gemma-3-4b-pt	unsloth	137	google/gemma-3-4b-it	42.4
gemma-3-270m-it-qat-q4_0-unquantized	medium	[DROP][]	gemma-3-270m-it	google	138	google/gemma-3-270m-it	42.4
gemma-3-12b-pt-bnb-4bit	medium	[DROP][]	gemma-3-12b-pt	unsloth	139	google/gemma-3-12b-pt	42.4
gemma-3-12b-it-qat-int4-unquantized	medium	[DROP][]	gemma-3-12b-pt	google	140	google/gemma-3-12b-it	42.4
gemma-3-27b-it-GGUF	medium	[DROP][]	gemma-3-27b-pt	Mungert	141	google/gemma-3-27b-pt	42.4
gemma-3-27b-it-qat-q4_0-unquantized	medium	[DROP][]	gemma-3-27b-it	google	142	google/gemma-3-27b-it	42.4
gemma-3-12b-pt-unsloth-bnb-4bit	medium	[DROP][]	gemma-3-12b-pt	unsloth	143	google/gemma-3-12b-pt	42.4
gemma-3-270m-it-bnb-4bit	medium	[DROP][]	gemma-3-270m-it	unsloth	144	google/gemma-3-270m-it	42.4
gemma-3-27b-it-qat-q4_0-gguf	medium	[DROP][]	gemma-3-27b-it	google	145	google/gemma-3-27b-it	42.4
gemma-3-27b-it-qat-q4_0-GGUF	medium	[DROP][]	gemma-3-27b-it	Mungert	146	google/gemma-3-27b-it	42.4
gemma-3-270m-it-qat	medium	[DROP][]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	147	google/gemma-3-270m-it-qat-q4_0-unquantized	42.4
gemma-3-4b-it-qat-bnb-4bit	medium	[DROP][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	148	google/gemma-3-4b-it-qat-q4_0-unquantized	42.4
gemma-3-1b-pt-bnb-4bit	medium	[DROP][]	gemma-3-1b-pt	unsloth	149	google/gemma-3-1b-pt	42.4
gemma-3-27b-pt	medium	[DROP][]	gemma-3-27b-pt	unsloth	150	google/gemma-3-27b-pt	42.4
gemma-3-12b-it-FP8-Dynamic	medium	[DROP][]	gemma-3-12b-pt	unsloth	151	google/gemma-3-12b-pt	42.4
gemma-3-270m-bnb-4bit	medium	[DROP][]	gemma-3-270m	unsloth	152	google/gemma-3-270m	42.4
gemma-3-1b-it-qat-int4-unquantized	medium	[DROP][]	gemma-3-1b-pt	google	153	google/gemma-3-1b-it	42.4
gemma-3-27b-pt-bnb-4bit	medium	[DROP][]	gemma-3-27b-pt	unsloth	154	google/gemma-3-27b-pt	42.4
gemma-3-12b-it-qat-unsloth-bnb-4bit	medium	[DROP][]	gemma-3-12b-it-qat-q4-0-unquantized	unsloth	155	google/gemma-3-12b-it-qat-q4_0-unquantized	42.4
gemma-3-270m-qat-q4_0-unquantized	medium	[DROP][]	gemma-3-270m	google	156	google/gemma-3-270m	42.4
gemma-3-12b-pt-qat-q4_0-gguf	medium	[DROP][]	gemma-3-12b-pt	google	157	google/gemma-3-12b-pt	42.4
gemma-3-270m-it-GGUF	medium	[DROP][]	gemma-3-270m	Mungert	158	google/gemma-3-270m	42.4
gemma-3-4b-it-qat	medium	[DROP][]	gemma-3-4b-it-qat-q4-0-unquantized	unsloth	159	google/gemma-3-4b-it-qat-q4_0-unquantized	42.4
gemma-3-270m-it-torchao-FP8	medium	[DROP][]	gemma-3-270m-it	unsloth	160	google/gemma-3-270m-it	42.4
gemma-3-1b-it-qat-q4_0-unquantized	medium	[DROP][]	gemma-3-1b-pt	google	161	google/gemma-3-1b-it	42.4
gemma-3-1b-it-qat	medium	[DROP][]	gemma-3-1b-it-qat-q4-0-unquantized	unsloth	162	google/gemma-3-1b-it-qat-q4_0-unquantized	42.4
gemma-3-27b-it-qat	medium	[DROP][]	gemma-3-27b-it-qat-q4-0-unquantized	unsloth	163	google/gemma-3-27b-it-qat-q4_0-unquantized	42.4
gemma-3-4b-pt-qat-q4_0-gguf	medium	[DROP][]	gemma-3-4b-pt	google	164	google/gemma-3-4b-pt	42.4
Youtu-LLM-2B-GGUF	medium	DROP	youtu-llm-2b-base	Mungert	165	tencent/Youtu-LLM-2B-Base	41.3
Synatra-V0.1-7B-Instruct-GGUF	medium	DROP (3-shot)	Unknown	TheBloke	166	maywell/Synatra-V0.1-7B-Instruct	39.63
t5gemma-2-270m-270m	medium	[DROP]	t5gemma-2-270m-270m	google	167	google/t5gemma-2-270m-270m	39.4
t5gemma-2-4b-4b	medium	[DROP]	t5gemma-2-4b-4b	google	168	google/t5gemma-2-4b-4b	39.4
t5gemma-2-1b-1b	medium	[DROP]	t5gemma-2-1b-1b	google	169	google/t5gemma-2-1b-1b	39.4
loyal-piano-m7-GGUF	low	Unknown	loyal-piano-m7	TheBloke	170	chargoddard/loyal-piano-m7	38.74
OLMo-2-0425-1B-Instruct	low	Unknown	olmo-2-0425-1b-rlvr1	allenai	171	allenai/OLMo-2-0425-1B-RLVR1	27.9
OLMo-2-0425-1B-SFT	low	Unknown	olmo-2-0425-1b	allenai	172	allenai/OLMo-2-0425-1B	27.9
OLMo-2-0425-1B-DPO	low	Unknown	Unknown	allenai	173	allenai/OLMo-2-0425-1B-SFT	27.9
OLMo-2-0425-1B-Instruct-GGUF	low	Unknown	olmo-2-0425-1b-instruct	unsloth	174	allenai/OLMo-2-0425-1B-Instruct	27.9
OLMo-2-0425-1B-Instruct	low	Unknown	olmo-2-0425-1b-instruct	unsloth	175	allenai/OLMo-2-0425-1B-Instruct	27.9
OLMo-2-0425-1B-RLVR1	low	Unknown	Unknown	allenai	176	allenai/OLMo-2-0425-1B-DPO	27.9
resilientai-team-mcte-mistral-voxtral-realtime-gptq-marlin	medium	GPTQ, layer 13	voxtral-mini-4b-realtime-2602	JaynadTodkarAmol	177	mistralai/Voxtral-Mini-4B-Realtime-2602	25
rocket-3B-GGUF	medium	DROP (3-shot)	rocket-3b	TheBloke	178	pansophic/rocket-3B	24.49
resilientai-team-mcte-mistral-voxtral-realtime-gptq-marlin	medium	GPTQ, layers 12-13	voxtral-mini-4b-realtime-2602	JaynadTodkarAmol	179	mistralai/Voxtral-Mini-4B-Realtime-2602	24
resilientai-team-mcte-mistral-voxtral-realtime-gptq-marlin	medium	GPTQ, layers 12-14	voxtral-mini-4b-realtime-2602	JaynadTodkarAmol	180	mistralai/Voxtral-Mini-4B-Realtime-2602	23
resilientai-team-mcte-mistral-voxtral-realtime-gptq-marlin	medium	GPTQ, layers 11-14	voxtral-mini-4b-realtime-2602	JaynadTodkarAmol	181	mistralai/Voxtral-Mini-4B-Realtime-2602	22
notus-7B-v1-GGUF	low	Unknown	notus-7b-v1	TheBloke	182	argilla/notus-7b-v1	9.66
notus-7B-v1-AWQ	low	Unknown	notus-7b-v1	TheBloke	183	argilla/notus-7b-v1	9.66
Synatra-7B-v0.3-dpo-GGUF	medium	DROP (3-shot)	Unknown	TheBloke	184	maywell/Synatra-7B-v0.3-dpo	8.68
speechless-mistral-dolphin-orca-platypus-samantha-7B-GGUF	medium	DROP	speechless-mistral-dolphin-orca-platypus-samantha-7b	TheBloke	185	uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7b	8.66
koOpenChat-sft-GGUF	medium	DROP (3-shot)	Unknown	TheBloke	186	maywell/koOpenChat-sft	7.82
llama2-7B-layla-GGUF	medium	DROP (3-shot)	Unknown	TheBloke	187	l3utterfly/llama2-7b-layla	6.57
neural-chat-7B-v3-1-GGUF	low	Unknown	neural-chat-7b-v3-1	TheBloke	188	Intel/neural-chat-7b-v3-1	6.14
juanako-7B-UNA-GGUF	low	Unknown	juanako-7b-una	TheBloke	189	fblgit/juanako-7b-UNA	6.14
open-llama-3b-v2-wizard-evol-instuct-v2-196k-GGUF	medium	DROP (3-shot)	open-llama-3b-v2-wizard-evol-instuct-v2-196k	TheBloke	190	harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196k	5.57

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/drop.html
url: huggingface.co/spaces/drop ↗