Leaderboard

MT-Bench

mt-bench

Record

Category: chat
Scored models: 178

Scores

Model	Score
nvidia/NVIDIA-Nemotron-Nano-9B-v2	89.2
openchat/openchat_v3.2_super	82.5
openchat/openchat_v3.2	82.5
Qwen/Qwen2.5-VL-7B-Instruct	63.7
Qwen/Qwen2-VL-7B	63.7
Qwen/Qwen2.5-VL-7B-Instruct	63.7
Qwen/Qwen2.5-VL-7B-Instruct	63.7
Qwen/Qwen2.5-VL-7B-Instruct	63.7
Qwen/Qwen2.5-VL-7B-Instruct	63.7
Qwen/Qwen2-VL-7B-Instruct	63.7
Qwen/Qwen2.5-VL-7B-Instruct	63.7
Qwen/Qwen2-VL-7B-Instruct	63.7
Qwen/Qwen2-VL-7B-Instruct	63.7
HuggingFaceTB/SmolLM2-135M	19.8
Qwen/Qwen3-32B	9.5
SanjiWatsuki/Kunoichi-7B	9.32
SanjiWatsuki/Kunoichi-7B	9.32
berkeley-nest/Starling-LM-7B-alpha	9.32
perlthoughts/Starling-LM-alpha-8x7B-MoE	9.32
berkeley-nest/Starling-LM-7B-alpha	9.32
berkeley-nest/Starling-LM-7B-alpha	9.32
tiiuae/Falcon-H1-34B-Base	9.2
tiiuae/Falcon-H1-34B-Instruct	9.2
tiiuae/Falcon-H1-34B-Instruct	9.2

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: chat
id: mt-bench
name: MT-Bench
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
NVIDIA-Nemotron-Nano-9B-v2-Japanese	medium	MT-Bench	nvidia-nemotron-nano-12b-v2-base	nvidia	1	nvidia/NVIDIA-Nemotron-Nano-9B-v2	89.2
openchat_v3.2_super-GGUF	low	Unknown	Unknown	TheBloke	2	openchat/openchat_v3.2_super	82.5
OpenChat_v3.2-GPTQ	low	Unknown	Unknown	TheBloke	3	openchat/openchat_v3.2	82.5
Qwen2.5-VL-7B-Instruct	medium	MMT-Bench<sub>test</sub>	qwen2-5-vl-7b-instruct	Qwen	4	Qwen/Qwen2.5-VL-7B-Instruct	63.7
Qwen2-VL-7B-Instruct	medium	MMT-Bench<sub>test</sub>	qwen2-vl-7b	Qwen	5	Qwen/Qwen2-VL-7B	63.7
Qwen2.5-VL-7B-Instruct-GGUF	medium	MMT-Bench<sub>test</sub>	qwen2-5-vl-7b-instruct	unsloth	6	Qwen/Qwen2.5-VL-7B-Instruct	63.7
Qwen2.5-VL-7B-Instruct	medium	MMT-Bench<sub>test</sub>	qwen2-5-vl-7b-instruct	unsloth	7	Qwen/Qwen2.5-VL-7B-Instruct	63.7
Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit	medium	MMT-Bench<sub>test</sub>	qwen2-5-vl-7b-instruct	unsloth	8	Qwen/Qwen2.5-VL-7B-Instruct	63.7
Qwen2.5-VL-7B-Instruct-bnb-4bit	medium	MMT-Bench<sub>test</sub>	qwen2-5-vl-7b-instruct	unsloth	9	Qwen/Qwen2.5-VL-7B-Instruct	63.7
Qwen2-VL-7B-Instruct-unsloth-bnb-4bit	medium	MMT-Bench<sub>test</sub>	qwen2-vl-7b-instruct	unsloth	10	Qwen/Qwen2-VL-7B-Instruct	63.7
Qwen2.5-VL-7B-Instruct-GGUF	medium	MMT-Bench<sub>test</sub>	qwen2-5-vl-7b-instruct	Mungert	11	Qwen/Qwen2.5-VL-7B-Instruct	63.7
Qwen2-VL-7B-Instruct-bnb-4bit	medium	MMT-Bench<sub>test</sub>	qwen2-vl-7b-instruct	unsloth	12	Qwen/Qwen2-VL-7B-Instruct	63.7
Qwen2-VL-7B-Instruct	medium	MMT-Bench<sub>test</sub>	qwen2-vl-7b-instruct	unsloth	13	Qwen/Qwen2-VL-7B-Instruct	63.7
SmolLM2-135M-Instruct-GGUF	medium	MT-Bench	smollm2-135m	Mungert	14	HuggingFaceTB/SmolLM2-135M	19.8
Qwen3-Nemotron-32B-RLBFF	low	Unknown	qwen3-32b	nvidia	15	Qwen/Qwen3-32B	9.5
Kunoichi-7B-GGUF	low	Unknown	Unknown	TheBloke	16	SanjiWatsuki/Kunoichi-7B	9.32
Kunoichi-7B-AWQ	low	Unknown	Unknown	TheBloke	17	SanjiWatsuki/Kunoichi-7B	9.32
Starling-LM-7B-alpha-GGUF	low	Unknown	starling-lm-7b-alpha	TheBloke	18	berkeley-nest/Starling-LM-7B-alpha	9.32
Starling-LM-alpha-8x7B-MoE-GGUF	low	Unknown	Unknown	TheBloke	19	perlthoughts/Starling-LM-alpha-8x7B-MoE	9.32
Starling-LM-7B-alpha-AWQ	low	Unknown	starling-lm-7b-alpha	TheBloke	20	berkeley-nest/Starling-LM-7B-alpha	9.32
Starling-LM-7B-alpha-GPTQ	low	Unknown	starling-lm-7b-alpha	TheBloke	21	berkeley-nest/Starling-LM-7B-alpha	9.32
Falcon-H1-34B-Instruct	medium	MTBench	falcon-h1-34b-base	tiiuae	22	tiiuae/Falcon-H1-34B-Base	9.2
Falcon-H1-34B-Instruct-GGUF	medium	MTBench	falcon-h1-34b-instruct	tiiuae	23	tiiuae/Falcon-H1-34B-Instruct	9.2
Falcon-H1-34B-Instruct-GGUF	medium	MTBench	falcon-h1-34b-instruct	unsloth	24	tiiuae/Falcon-H1-34B-Instruct	9.2
Falcon-H1-34B-Instruct-GPTQ-Int4	medium	MTBench	falcon-h1-34b-instruct	tiiuae	25	tiiuae/Falcon-H1-34B-Instruct	9.2
Llama-3.1-Nemotron-70B-Instruct-HF	low	Unknown	Unknown	nvidia	26	meta-llama/Llama-3.1-70B-Instruct	8.98
Llama-3.1-Nemotron-70B-Instruct	low	Unknown	Unknown	nvidia	27	meta-llama/Llama-3.1-70B-Instruct	8.98
Qwen2-72B-Instruct	medium	MT-Bench	qwen2-72b	Qwen	28	Qwen/Qwen2-72B	8.95
Falcon-H1-7B-Instruct	medium	MTBench	falcon-h1-7b-base	tiiuae	29	tiiuae/Falcon-H1-7B-Base	8.85
Falcon-H1-7B-Instruct-GPTQ-Int4	medium	MTBench	falcon-h1-7b-instruct	tiiuae	30	tiiuae/Falcon-H1-7B-Instruct	8.85
DeepSeek-V2.5	medium	MT-Bench	deepseek-v2-5	deepseek-ai	31	deepseek-ai/DeepSeek-V2.5	8.85
Falcon-H1-7B-Instruct-GGUF	medium	MTBench	falcon-h1-7b-instruct	tiiuae	32	tiiuae/Falcon-H1-7B-Instruct	8.85
Falcon-H1-7B-Instruct-GGUF	medium	MTBench	falcon-h1-7b-instruct	unsloth	33	tiiuae/Falcon-H1-7B-Instruct	8.85
Falcon-H1-3B-Instruct	medium	MTBench	falcon-h1-3b-base	tiiuae	34	tiiuae/Falcon-H1-3B-Base	8.72
Falcon-H1-3B-Instruct-GGUF	medium	MTBench	falcon-h1-3b-base	tiiuae	35	tiiuae/Falcon-H1-3B-Base	8.72
Falcon-H1-3B-Instruct-GGUF	medium	MTBench	falcon-h1-3b-instruct	unsloth	36	tiiuae/Falcon-H1-3B-Instruct	8.72
Mistral-Large-Instruct-2407	medium	MT Bench	mistral-large-instruct-2407	mistralai	37	mistralai/Mistral-Large-Instruct-2407	8.63
Falcon-H1-1.5B-Deep-Instruct	medium	MTBench	falcon-h1-1-5b-deep-base	tiiuae	38	tiiuae/Falcon-H1-1.5B-Deep-Base	8.53
Falcon-H1-1.5B-Deep-Instruct-GGUF	medium	MTBench	falcon-h1-1-5b-deep-instruct	tiiuae	39	tiiuae/Falcon-H1-1.5B-Deep-Instruct	8.53
Falcon-H1-1.5B-Deep-Instruct-GGUF	medium	MTBench	falcon-h1-1-5b-deep-instruct	unsloth	40	tiiuae/Falcon-H1-1.5B-Deep-Instruct	8.53
Falcon-H1-1.5B-Deep-Instruct	medium	MTBench	falcon-h1-1-5b-deep-instruct	unsloth	41	tiiuae/Falcon-H1-1.5B-Deep-Instruct	8.53
Falcon-H1-1.5B-Deep-Instruct-GPTQ-Int4	medium	MTBench	falcon-h1-1-5b-deep-instruct	tiiuae	42	tiiuae/Falcon-H1-1.5B-Deep-Instruct	8.53
Falcon-H1-1.5B-Instruct	medium	MTBench	falcon-h1-1-5b-base	tiiuae	43	tiiuae/Falcon-H1-1.5B-Base	8.46
Falcon-H1-1.5B-Instruct-GGUF	medium	MTBench	falcon-h1-1-5b-instruct	tiiuae	44	tiiuae/Falcon-H1-1.5B-Instruct	8.46
Falcon-H1-1.5B-Instruct-GGUF	medium	MTBench	falcon-h1-1-5b-instruct	unsloth	45	tiiuae/Falcon-H1-1.5B-Instruct	8.46
Falcon-H1-1.5B-Instruct-GPTQ-Int4	medium	MTBench	falcon-h1-1-5b-instruct	tiiuae	46	tiiuae/Falcon-H1-1.5B-Instruct	8.46
Falcon-H1-1.5B-Instruct-GPTQ-Int8	medium	MTBench	falcon-h1-1-5b-instruct	tiiuae	47	tiiuae/Falcon-H1-1.5B-Instruct	8.46
glm-4-9b-chat	high	Unknown	glm-4-9b-chat	zai-org	48	zai-org/glm-4-9b-chat	8.35
Mistral-Small-24B-Instruct-2501	medium	mtbench_dev	mistral-small-24b-base-2501	mistralai	49	mistralai/Mistral-Small-24B-Base-2501	8.35
glm-4-9b-chat-hf	high	Unknown	glm-4-9b-chat	zai-org	50	THUDM/glm-4-9b-chat	8.35
Mistral-Small-24B-Instruct-2501-bnb-4bit	medium	mtbench_dev	mistral-small-24b-instruct-2501	unsloth	51	mistralai/Mistral-Small-24B-Instruct-2501	8.35
Mistral-Small-24B-Instruct-2501-GGUF	medium	mtbench_dev	mistral-small-24b-instruct-2501	unsloth	52	mistralai/Mistral-Small-24B-Instruct-2501	8.35
Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit	medium	mtbench_dev	mistral-small-24b-instruct-2501	unsloth	53	mistralai/Mistral-Small-24B-Instruct-2501	8.35
Mistral-Small-24B-Instruct-2501	medium	mtbench_dev	mistral-small-24b-instruct-2501	unsloth	54	mistralai/Mistral-Small-24B-Instruct-2501	8.35
Mistral-Small-24B-Base-2501-unsloth-bnb-4bit	medium	mtbench_dev	mistral-small-24b-base-2501	unsloth	55	mistralai/Mistral-Small-24B-Base-2501	8.35
Qwen2-57B-A14B-Instruct	medium	MT-Bench	qwen2-57b-a14b	Qwen	56	Qwen/Qwen2-57B-A14B	8.3
Qwen2-7B-Instruct	medium	MT-Bench	qwen2-7b	Qwen	57	Qwen/Qwen2-7B	8.05
Nemotron-H-4B-Instruct-128K	low	Unknown	nemotron-h-4b-base-8k	nvidia	58	nvidia/Nemotron-H-4B-Base-8K	7.9
openchat-3.5-0106-GGUF	high	BBH CoT	openchat-3-5-0106	TheBloke	59	openchat/openchat-3.5-0106	7.81
openchat_3.5-GGUF	low	BBH CoT	Unknown	TheBloke	60	openchat/openchat_3.5	7.81
openchat_3.5-16k-GGUF	low	BBH CoT	Unknown	TheBloke	61	NurtureAI/openchat_3.5-16k	7.81
openchat_3.5-GPTQ	low	BBH CoT	Unknown	TheBloke	62	openchat/openchat_3.5	7.81
openchat-3.5-1210-GGUF	high	BBH CoT	openchat-3-5-1210	TheBloke	63	openchat/openchat-3.5-1210	7.76
openchat-3.5-1210-GPTQ	high	BBH CoT	openchat-3-5-1210	TheBloke	64	openchat/openchat-3.5-1210	7.76
Phi-mini-MoE-instruct	high	Unknown	phi-mini-moe-instruct	microsoft	65	microsoft/Phi-mini-MoE-instruct	7.59
CapybaraHermes-2.5-Mistral-7B-GGUF	low	Unknown	capybarahermes-2-5-mistral-7b	TheBloke	66	argilla/CapybaraHermes-2.5-Mistral-7B	7.56
CapybaraHermes-2.5-Mistral-7B-GPTQ	low	Unknown	capybarahermes-2-5-mistral-7b	TheBloke	67	argilla/CapybaraHermes-2.5-Mistral-7B	7.56
CapybaraHermes-2.5-Mistral-7B-AWQ	low	Unknown	capybarahermes-2-5-mistral-7b	TheBloke	68	argilla/CapybaraHermes-2.5-Mistral-7B	7.56
deita-7B-v1.0-sft-GGUF	high	Unknown	Unknown	TheBloke	69	hkust-nlp/deita-7b-v1.0-sft	7.55
Mistral-Small-3.1-24B-Instruct-2503	low	Unknown	mistral-small-3-1-24b-base-2503	mistralai	70	mistralai/Mistral-Small-3.1-24B-Base-2503	7.3
Mistral-Small-3.1-24B-Instruct-2503-GGUF	low	Unknown	mistral-small-3-1-24b-instruct-2503	unsloth	71	mistralai/Mistral-Small-3.1-24B-Instruct-2503	7.3
Mistral-Small-3.1-24B-Instruct-2503-bnb-4bit	low	Unknown	mistral-small-3-1-24b-instruct-2503	unsloth	72	mistralai/Mistral-Small-3.1-24B-Instruct-2503	7.3
Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit	low	Unknown	mistral-small-3-1-24b-instruct-2503	unsloth	73	mistralai/Mistral-Small-3.1-24B-Instruct-2503	7.3
Mistral-Small-3.1-24B-Instruct-2503	low	Unknown	mistral-small-3-1-24b-instruct-2503	unsloth	74	mistralai/Mistral-Small-3.1-24B-Instruct-2503	7.3
Mistral-Small-3.1-24B-Instruct-2503-GGUF	low	Unknown	mistral-small-3-1-24b-base-2503	Mungert	75	mistralai/Mistral-Small-3.1-24B-Base-2503	7.3
Falcon-H1-0.5B-Instruct	medium	MTBench	falcon-h1-0-5b-base	tiiuae	76	tiiuae/Falcon-H1-0.5B-Base	7.06
Falcon-H1-0.5B-Instruct-GGUF	medium	MTBench	falcon-h1-0-5b-base	tiiuae	77	tiiuae/Falcon-H1-0.5B-Base	7.06
Falcon-H1-0.5B-Instruct-GGUF	medium	MTBench	falcon-h1-0-5b-instruct	unsloth	78	tiiuae/Falcon-H1-0.5B-Instruct	7.06
Phi-tiny-MoE-instruct	high	Unknown	phi-tiny-moe-instruct	microsoft	79	microsoft/Phi-tiny-MoE-instruct	7.05
Pixtral-Large-Instruct-2411	low	MathVista (CoT) \| MMMU (CoT) \| ChartQA (CoT)	Unknown	mistralai	80	mistralai/Pixtral-Large-Instruct-2411	6.8
Ministral-3-3B-Instruct-2512	low	Unknown	ministral-3-3b-base-2512	mistralai	81	mistralai/Ministral-3-3B-Base-2512	6.7
Ministral-8B-Instruct-2410	low	Unknown	ministral-8b-instruct-2410	mistralai	82	mistralai/Ministral-8B-Instruct-2410	6.7
Ministral-3-3B-Instruct-2512-BF16	low	Unknown	ministral-3-3b-base-2512	mistralai	83	mistralai/Ministral-3-3B-Base-2512	6.7
Ministral-3-14B-Instruct-2512	low	Unknown	ministral-3-14b-base-2512	mistralai	84	mistralai/Ministral-3-14B-Base-2512	6.7
Ministral-3-3B-Reasoning-2512	low	Unknown	ministral-3-3b-base-2512	mistralai	85	mistralai/Ministral-3-3B-Base-2512	6.7
Ministral-3-8B-Instruct-2512	low	Unknown	ministral-3-8b-base-2512	mistralai	86	mistralai/Ministral-3-8B-Base-2512	6.7
Ministral-3-14B-Reasoning-2512	low	Unknown	ministral-3-14b-base-2512	mistralai	87	mistralai/Ministral-3-14B-Base-2512	6.7
Ministral-3-8B-Reasoning-2512	low	Unknown	ministral-3-8b-base-2512	mistralai	88	mistralai/Ministral-3-8B-Base-2512	6.7
Ministral-3-3B-Reasoning-2512-GGUF	low	Unknown	ministral-3-3b-reasoning-2512	unsloth	89	mistralai/Ministral-3-3B-Reasoning-2512	6.7
Ministral-3-8B-Instruct-2512-BF16	low	Unknown	ministral-3-8b-base-2512	mistralai	90	mistralai/Ministral-3-8B-Base-2512	6.7
Ministral-3-14B-Instruct-2512-BF16	low	Unknown	ministral-3-14b-base-2512	mistralai	91	mistralai/Ministral-3-14B-Base-2512	6.7
Ministral-3-3B-Instruct-2512-GGUF	low	Unknown	ministral-3-3b-base-2512	unsloth	92	mistralai/Ministral-3-3B-Instruct-2512	6.7
Ministral-3-8B-Instruct-2512-GGUF	low	Unknown	ministral-3-8b-instruct-2512	unsloth	93	mistralai/Ministral-3-8B-Instruct-2512	6.7
Ministral-3-8B-Base-2512	low	Unknown	ministral-3-8b-base-2512	mistralai	94	mistralai/Ministral-3-8B-Base-2512	6.7
Ministral-3-14B-Instruct-2512-GGUF	low	Unknown	ministral-3-14b-instruct-2512	unsloth	95	mistralai/Ministral-3-14B-Instruct-2512	6.7
Ministral-3-3B-Base-2512	low	Unknown	ministral-3-3b-base-2512	mistralai	96	mistralai/Ministral-3-3B-Base-2512	6.7
Ministral-3-14B-Reasoning-2512-GGUF	low	Unknown	ministral-3-14b-reasoning-2512	unsloth	97	mistralai/Ministral-3-14B-Reasoning-2512	6.7
Ministral-3-14B-Base-2512	low	Unknown	ministral-3-14b-base-2512	mistralai	98	mistralai/Ministral-3-14B-Base-2512	6.7
Ministral-3-8B-Reasoning-2512-GGUF	low	Unknown	ministral-3-8b-reasoning-2512	unsloth	99	mistralai/Ministral-3-8B-Reasoning-2512	6.7
Ministral-3-3B-Instruct-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-3b-base-2512	unsloth	100	mistralai/Ministral-3-3B-Instruct-2512	6.7
Ministral-3-3B-Reasoning-2512	low	Unknown	ministral-3-3b-reasoning-2512	unsloth	101	mistralai/Ministral-3-3B-Reasoning-2512	6.7
Ministral-3-8B-Instruct-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-8b-instruct-2512	unsloth	102	mistralai/Ministral-3-8B-Instruct-2512	6.7
Ministral-3-8B-Instruct-2512	low	Unknown	ministral-3-8b-instruct-2512	unsloth	103	mistralai/Ministral-3-8B-Instruct-2512	6.7
Ministral-3-3B-Instruct-2512	low	Unknown	ministral-3-3b-base-2512	unsloth	104	mistralai/Ministral-3-3B-Instruct-2512	6.7
Ministral-3-14B-Instruct-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-14b-instruct-2512	unsloth	105	mistralai/Ministral-3-14B-Instruct-2512	6.7
Ministral-3-14B-Instruct-2512-bnb-4bit	low	Unknown	ministral-3-14b-instruct-2512	unsloth	106	mistralai/Ministral-3-14B-Instruct-2512	6.7
Ministral-3-14B-Instruct-2512	low	Unknown	ministral-3-14b-instruct-2512	unsloth	107	mistralai/Ministral-3-14B-Instruct-2512	6.7
Ministral-3-3B-Base-2512	low	Unknown	ministral-3-3b-base-2512	unsloth	108	mistralai/Ministral-3-3B-Base-2512	6.7
Ministral-3-3B-Base-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-3b-base-2512	unsloth	109	mistralai/Ministral-3-3B-Base-2512	6.7
Ministral-3-14B-Reasoning-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-14b-reasoning-2512	unsloth	110	mistralai/Ministral-3-14B-Reasoning-2512	6.7
Ministral-3-14B-Instruct-2512-FP8	low	Unknown	ministral-3-14b-instruct-2512	unsloth	111	mistralai/Ministral-3-14B-Instruct-2512	6.7
Ministral-3-3B-Reasoning-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-3b-reasoning-2512	unsloth	112	mistralai/Ministral-3-3B-Reasoning-2512	6.7
Ministral-3-3B-Instruct-2512-bnb-4bit	low	Unknown	ministral-3-3b-base-2512	unsloth	113	mistralai/Ministral-3-3B-Instruct-2512	6.7
Ministral-3-8B-Instruct-2512-FP8	low	Unknown	ministral-3-8b-instruct-2512	unsloth	114	mistralai/Ministral-3-8B-Instruct-2512	6.7
Ministral-3-14B-Reasoning-2512-bnb-4bit	low	Unknown	ministral-3-14b-reasoning-2512	unsloth	115	mistralai/Ministral-3-14B-Reasoning-2512	6.7
Ministral-3-3B-Base-2512-bnb-4bit	low	Unknown	ministral-3-3b-base-2512	unsloth	116	mistralai/Ministral-3-3B-Base-2512	6.7
Ministral-3-8B-Base-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-8b-base-2512	unsloth	117	mistralai/Ministral-3-8B-Base-2512	6.7
Ministral-3-8B-Reasoning-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-8b-reasoning-2512	unsloth	118	mistralai/Ministral-3-8B-Reasoning-2512	6.7
Ministral-3-8B-Instruct-2512-bnb-4bit	low	Unknown	ministral-3-8b-instruct-2512	unsloth	119	mistralai/Ministral-3-8B-Instruct-2512	6.7
Ministral-3-8B-Base-2512	low	Unknown	ministral-3-8b-base-2512	unsloth	120	mistralai/Ministral-3-8B-Base-2512	6.7
Ministral-3-8B-Reasoning-2512-GGUF	low	Unknown	ministral-3-8b-base-2512	Mungert	121	mistralai/Ministral-3-8B-Base-2512	6.7
Ministral-3-14B-Base-2512-unsloth-bnb-4bit	low	Unknown	ministral-3-14b-base-2512	unsloth	122	mistralai/Ministral-3-14B-Base-2512	6.7
Ministral-3-14B-Reasoning-2512	low	Unknown	ministral-3-14b-reasoning-2512	unsloth	123	mistralai/Ministral-3-14B-Reasoning-2512	6.7
Ministral-3-3B-Instruct-2512-FP8	low	Unknown	ministral-3-3b-base-2512	unsloth	124	mistralai/Ministral-3-3B-Instruct-2512	6.7
Ministral-3-14B-Reasoning-2512-GGUF	low	Unknown	ministral-3-14b-base-2512	Mungert	125	mistralai/Ministral-3-14B-Base-2512	6.7
Ministral-3-3B-Reasoning-2512-GGUF	low	Unknown	ministral-3-3b-base-2512	Mungert	126	mistralai/Ministral-3-3B-Base-2512	6.7
Ministral-3-8B-Reasoning-2512	low	Unknown	ministral-3-8b-reasoning-2512	unsloth	127	mistralai/Ministral-3-8B-Reasoning-2512	6.7
Ministral-3-3B-Reasoning-2512-bnb-4bit	low	Unknown	ministral-3-3b-reasoning-2512	unsloth	128	mistralai/Ministral-3-3B-Reasoning-2512	6.7
granite-7b-instruct-GGUF	low	Unknown	Unknown	Mungert	129	ibm/granite-7b-base	6.65
stablelm-zephyr-3b-GGUF	low	Unknown	stablelm-zephyr-3b	TheBloke	130	stabilityai/stablelm-zephyr-3b	6.64
Pixtral-12B-2409	medium	Text MT-Bench	Unknown	mistralai	131	mistralai/Pixtral-12B-Base-2409	6.41
tulu-2-7b	low	Unknown	llama-2-7b-hf	allenai	132	meta-llama/Llama-2-7b-hf	6.3
tulu-2-13B-GGUF	low	Unknown	Unknown	TheBloke	133	allenai/tulu-2-13b	6.3
tulu-2-dpo-7b	low	Unknown	llama-2-7b-hf	allenai	134	meta-llama/Llama-2-7b-hf	6.3
tulu-2-dpo-13b	low	Unknown	llama-2-13b-hf	allenai	135	meta-llama/Llama-2-13b-hf	6.3
tulu-2-dpo-70b	low	Unknown	llama-2-70b-hf	allenai	136	meta-llama/Llama-2-70b-hf	6.3
tulu-2-dpo-13B-GGUF	low	Unknown	Unknown	TheBloke	137	allenai/tulu-2-dpo-13b	6.3
tulu-2-dpo-70B-GGUF	low	Unknown	Unknown	TheBloke	138	allenai/tulu-2-dpo-70b	6.3
tulu-2-7B-GGUF	low	Unknown	Unknown	TheBloke	139	allenai/tulu-2-7b	6.3
tulu-2-13b	low	Unknown	llama-2-13b-hf	allenai	140	meta-llama/Llama-2-13b-hf	6.3
tulu-2-70B-GGUF	low	Unknown	Unknown	TheBloke	141	allenai/tulu-2-70b	6.3
tulu-2-dpo-7B-GGUF	low	Unknown	Unknown	TheBloke	142	allenai/tulu-2-dpo-7b	6.3
tulu-2-dpo-13B-AWQ	low	Unknown	Unknown	TheBloke	143	allenai/tulu-2-dpo-13b	6.3
SmolLM2-1.7B-Instruct-GGUF	medium	MT-Bench	smollm2-1-7b	Mungert	144	HuggingFaceTB/SmolLM2-1.7B	6.13
Genz-70b-GGUF	low	Unknown	Unknown	TheBloke	145	budecosystem/genz-70b	6.12
genz-13B-v2-GGUF	low	Unknown	Unknown	TheBloke	146	budecosystem/genz-13b-v2	6.12
Qwen2.5-Omni-3B	medium	MM-MT-Bench	qwen2-5-omni-3b	Qwen	147	Qwen/Qwen2.5-Omni-3B	6
Qwen2.5-Omni-7B	medium	MM-MT-Bench	qwen2-5-omni-7b	Qwen	148	Qwen/Qwen2.5-Omni-7B	6
Qwen2.5-Omni-7B-GGUF	medium	MM-MT-Bench	qwen2-5-omni-7b	unsloth	149	Qwen/Qwen2.5-Omni-7B	6
Qwen2.5-Omni-3B-GGUF	medium	MM-MT-Bench	qwen2-5-omni-3b	unsloth	150	Qwen/Qwen2.5-Omni-3B	6
Qwen2.5-Omni-3B-GGUF	medium	MM-MT-Bench	qwen2-5-omni-3b	Mungert	151	Qwen/Qwen2.5-Omni-3B	6
Qwen2.5-Omni-7B	medium	MM-MT-Bench	qwen2-5-omni-7b	unsloth	152	Qwen/Qwen2.5-Omni-7B	6
Qwen2.5-Omni-7B-GGUF	medium	MM-MT-Bench	qwen2-5-omni-7b	Mungert	153	Qwen/Qwen2.5-Omni-7B	6
Qwen2.5-Omni-3B	medium	MM-MT-Bench	qwen2-5-omni-3b	unsloth	154	Qwen/Qwen2.5-Omni-3B	6
bitnet-b1.58-2B-4T-gguf	medium	MT-bench	bitnet-b1-58-2b-4t-bf16	microsoft	155	microsoft/bitnet-b1.58-2B-4T-bf16	5.43
bitnet-b1.58-2B-4T	medium	MT-bench	bitnet-b1-58-2b-4t	microsoft	156	microsoft/bitnet-b1.58-2B-4T	5.43
bitnet-b1.58-2B-4T-bf16	medium	MT-bench	bitnet-b1-58-2b-4t-bf16	microsoft	157	microsoft/bitnet-b1.58-2B-4T-bf16	5.43
Pixtral-12B-2409	medium	MM MT-Bench	Unknown	mistralai	158	mistralai/Pixtral-12B-Base-2409	5.43
SmolLM2-360M-Instruct-GGUF	medium	MT-Bench	smollm2-360m	Mungert	159	HuggingFaceTB/SmolLM2-360M	3.66
MiniMax-M3-DSpark	low	Unknown	minimax-m3	nvidia	160	MiniMaxAI/MiniMax-M3	3.22
Kimi-K2.6-DFlash	low	Unknown	kimi-k2-6	nvidia	161	moonshotai/Kimi-K2.6	3
Kimi-K2.7-Code-DFlash	low	Unknown	Unknown	nvidia	162	moonshotai/Kimi-K2.7-Code	2.9
rocket-3B-GGUF	low	Unknown	rocket-3b	TheBloke	163	pansophic/rocket-3B	2.75
zephyr-7B-beta-GGUF	low	Unknown	zephyr-7b-beta	TheBloke	164	HuggingFaceH4/zephyr-7b-beta	2.75
zephyr-7B-beta-AWQ	low	Unknown	zephyr-7b-beta	TheBloke	165	HuggingFaceH4/zephyr-7b-beta	2.75
zephyr-7B-beta-GPTQ	low	Unknown	zephyr-7b-beta	TheBloke	166	HuggingFaceH4/zephyr-7b-beta	2.75
Kimi-K2.5-Thinking-Eagle3	low	Unknown	kimi-k2-5	nvidia	167	moonshotai/Kimi-K2.5	2.62
Kimi-K2.6-Eagle3	low	Unknown	kimi-k2-6	nvidia	168	moonshotai/Kimi-K2.6	2.41
Kimi-K2-Thinking-Eagle3	low	Unknown	kimi-k2-thinking	nvidia	169	moonshotai/Kimi-K2-Thinking	2.28
gpt-oss-120b-Eagle3-long-context	low	Unknown	gpt-oss-120b	nvidia	170	openai/gpt-oss-120b	2.24
Qwen3-235B-A22B-Eagle3	low	Unknown	Unknown	nvidia	171	Qwen/Qwen3-235B-A22B	2.21
Qwen3-235B-A22B-Thinking-2507-FP4-Eagle3	low	Unknown	Unknown	nvidia	172	Qwen/Qwen3-235B-A22B-Thinking-2507-FP4	2.13
gpt-oss-120b-Eagle3-short-context	low	Unknown	gpt-oss-120b	nvidia	173	openai/gpt-oss-120b	2.1
Llama-3.3-70B-Instruct-Eagle3	low	Unknown	Unknown	nvidia	174	nvidia/Llama-3.3-70B-Instruct-FP4	2.1
Llama-3.1-8B-Medusa-FP8	high	Unknown	Unknown	nvidia	175	—	2.07
Qwen3-30B-A3B-Thinking-2507-Eagle3	low	Unknown	Unknown	nvidia	176	Qwen/Qwen3-30-A3B-Thinking-2507	1.88
Qwen3-235B-A22B-Thinking-2507-Eagle3	low	Unknown	qwen3-235b-a22b-thinking-2507	nvidia	177	Qwen/Qwen3-235B-A22B-Thinking-2507	1.83
gpt-oss-120b-Eagle3-throughput	low	Unknown	gpt-oss-120b	nvidia	178	openai/gpt-oss-120b	1.72

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/mt-bench.html
url: huggingface.co/spaces/mt-bench ↗