Leaderboard

AlpacaEval

alpacaeval

Record

Category: chat
Scored models: 130

Scores

Model	Score
berkeley-nest/Starling-LM-7B-alpha	97.7
perlthoughts/Starling-LM-alpha-8x7B-MoE	97.7
berkeley-nest/Starling-LM-7B-alpha	97.7
berkeley-nest/Starling-LM-7B-alpha	97.7
Xwin-LM/Xwin-LM-70b-V0.1	95.57
Xwin-LM/Xwin-LM-13B-V0.1	95.57
Xwin-LM/Xwin-LM-13B-V0.2	95.57
Xwin-LM/Xwin-LM-7B-V0.2	95.57
Xwin-LM/Xwin-LM-7b-V0.1	95.57
Xwin-LM/Xwin-LM-13B-V0.1	95.57
Xwin-LM/Xwin-LM-70b-V0.1	95.57
openchat/openchat_v3.2_super	95.3
openchat/openchat_v3.2	95.3
meta-llama/Meta-Llama-3-8B	94.65
meta-llama/Meta-Llama-3-70B	94.65
hkust-nlp/deita-7b-v1.0-sft	90.06
HuggingFaceH4/zephyr-7b-beta	87.83
HuggingFaceH4/zephyr-7b-beta	87.83
HuggingFaceH4/zephyr-7b-beta	87.83
stabilityai/stablelm-zephyr-3b	76
meta-llama/Llama-2-7b-hf	73.9
allenai/tulu-2-13b	73.9
meta-llama/Llama-2-7b-hf	73.9
meta-llama/Llama-2-13b-hf	73.9

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: chat
id: alpacaeval
name: AlpacaEval
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
Starling-LM-7B-alpha-GGUF	low	AlpacaEval	starling-lm-7b-alpha	TheBloke	1	berkeley-nest/Starling-LM-7B-alpha	97.7
Starling-LM-alpha-8x7B-MoE-GGUF	low	AlpacaEval	Unknown	TheBloke	2	perlthoughts/Starling-LM-alpha-8x7B-MoE	97.7
Starling-LM-7B-alpha-AWQ	low	AlpacaEval	starling-lm-7b-alpha	TheBloke	3	berkeley-nest/Starling-LM-7B-alpha	97.7
Starling-LM-7B-alpha-GPTQ	low	AlpacaEval	starling-lm-7b-alpha	TheBloke	4	berkeley-nest/Starling-LM-7B-alpha	97.7
Xwin-LM-70B-V0.1-GGUF	low	AlpacaEval (winrate %)	Unknown	TheBloke	5	Xwin-LM/Xwin-LM-70b-V0.1	95.57
Xwin-LM-13B-V0.1-GGUF	low	AlpacaEval (winrate %)	Unknown	TheBloke	6	Xwin-LM/Xwin-LM-13B-V0.1	95.57
Xwin-LM-13B-v0.2-GGUF	low	AlpacaEval (winrate %)	Unknown	TheBloke	7	Xwin-LM/Xwin-LM-13B-V0.2	95.57
Xwin-LM-7B-V0.2-GGUF	low	AlpacaEval (winrate %)	Unknown	TheBloke	8	Xwin-LM/Xwin-LM-7B-V0.2	95.57
Xwin-LM-7B-V0.1-GGUF	low	AlpacaEval (winrate %)	Unknown	TheBloke	9	Xwin-LM/Xwin-LM-7b-V0.1	95.57
Xwin-LM-13B-V0.1-GPTQ	low	AlpacaEval (winrate %)	Unknown	TheBloke	10	Xwin-LM/Xwin-LM-13B-V0.1	95.57
Xwin-LM-70B-V0.1-AWQ	low	AlpacaEval (winrate %)	Unknown	TheBloke	11	Xwin-LM/Xwin-LM-70b-V0.1	95.57
openchat_v3.2_super-GGUF	low	AlpacaEval (win rate %)	Unknown	TheBloke	12	openchat/openchat_v3.2_super	95.3
OpenChat_v3.2-GPTQ	low	AlpacaEval (win rate %)	Unknown	TheBloke	13	openchat/openchat_v3.2	95.3
llama-3-tulu-2-8b	low	GSM8k 8-shot cot \| BBH 3-shot cot	meta-llama-3-8b	allenai	14	meta-llama/Meta-Llama-3-8B	94.65
llama-3-tulu-2-70b	low	GSM8k 8-shot cot \| BBH 3-shot cot	meta-llama-3-70b	allenai	15	meta-llama/Meta-Llama-3-70B	94.65
deita-7B-v1.0-sft-GGUF	high	AlpacaEval(%)	Unknown	TheBloke	16	hkust-nlp/deita-7b-v1.0-sft	90.06
zephyr-7B-beta-GGUF	low	AlpacaEval (win rate %)	zephyr-7b-beta	TheBloke	17	HuggingFaceH4/zephyr-7b-beta	87.83
zephyr-7B-beta-AWQ	low	AlpacaEval (win rate %)	zephyr-7b-beta	TheBloke	18	HuggingFaceH4/zephyr-7b-beta	87.83
zephyr-7B-beta-GPTQ	low	AlpacaEval (win rate %)	zephyr-7b-beta	TheBloke	19	HuggingFaceH4/zephyr-7b-beta	87.83
stablelm-zephyr-3b-GGUF	low	AlpacaEval (win rate %)	stablelm-zephyr-3b	TheBloke	20	stabilityai/stablelm-zephyr-3b	76
tulu-2-7b	low	AlpacaEval (win rate %)	llama-2-7b-hf	allenai	21	meta-llama/Llama-2-7b-hf	73.9
tulu-2-13B-GGUF	low	AlpacaEval (win rate %)	llama-2-13b-hf	TheBloke	22	allenai/tulu-2-13b	73.9
tulu-2-dpo-7b	low	AlpacaEval (win rate %)	llama-2-7b-hf	allenai	23	meta-llama/Llama-2-7b-hf	73.9
tulu-2-dpo-13b	low	AlpacaEval (win rate %)	llama-2-13b-hf	allenai	24	meta-llama/Llama-2-13b-hf	73.9
tulu-2-dpo-70b	low	AlpacaEval (win rate %)	llama-2-70b-hf	allenai	25	meta-llama/Llama-2-70b-hf	73.9
tulu-2-dpo-13B-GGUF	low	AlpacaEval (win rate %)	llama-2-13b-hf	TheBloke	26	allenai/tulu-2-dpo-13b	73.9
tulu-2-dpo-70B-GGUF	low	AlpacaEval (win rate %)	llama-2-70b-hf	TheBloke	27	allenai/tulu-2-dpo-70b	73.9
tulu-2-7B-GGUF	low	AlpacaEval (win rate %)	llama-2-7b-hf	TheBloke	28	allenai/tulu-2-7b	73.9
tulu-2-13b	low	AlpacaEval (win rate %)	llama-2-13b-hf	allenai	29	meta-llama/Llama-2-13b-hf	73.9
tulu-2-70B-GGUF	low	AlpacaEval (win rate %)	llama-2-70b-hf	TheBloke	30	allenai/tulu-2-70b	73.9
tulu-2-dpo-7B-GGUF	low	AlpacaEval (win rate %)	llama-2-7b-hf	TheBloke	31	allenai/tulu-2-dpo-7b	73.9
tulu-2-dpo-13B-AWQ	low	AlpacaEval (win rate %)	llama-2-13b-hf	TheBloke	32	allenai/tulu-2-dpo-13b	73.9
claude2-alpaca-13B-GGUF	low	Alpaca_Eval	Unknown	TheBloke	33	umd-zhou-lab/claude2-alpaca-13B	71.37
claude2-alpaca-7B-GGUF	low	Alpaca_Eval	Unknown	TheBloke	34	umd-zhou-lab/claude2-alpaca-7B	71.37
OLMo-7B-0724-Instruct-hf	low	AlpacaEval %win ↑	olmo-7b-0724-instruct-hf	allenai	35	allenai/OLMo-7B-0724-Instruct-hf	70.9
OLMo-7B-0724-SFT-hf	low	AlpacaEval %win ↑	olmo-7b-0724-sft-hf	allenai	36	allenai/OLMo-7B-0724-SFT-hf	70.9
OLMo-7B-0424-Instruct-hf	low	AlpacaEval %win ↑	olmo-7b-0424-instruct-hf	allenai	37	allenai/OLMo-7B-0424-Instruct-hf	70.4
DeepSeek-V3	high	AlpacaEval 2.0	deepseek-v2	deepseek-ai	38	deepseek-ai/DeepSeek-V2	70
DeepSeek-V3-Base	high	AlpacaEval 2.0	deepseek-v2	deepseek-ai	39	deepseek-ai/DeepSeek-V2	70
DeepSeek-V3	high	AlpacaEval 2.0	deepseek-v3	unsloth	40	deepseek-ai/DeepSeek-V3	70
DeepSeek-V3-bf16	high	AlpacaEval 2.0	deepseek-v3	unsloth	41	deepseek-ai/DeepSeek-V3	70
DeepSeek-V3-GGUF	high	AlpacaEval 2.0	deepseek-v3	unsloth	42	deepseek-ai/DeepSeek-V3	70
Olmo-3-32B-Think	medium	AlpacaEval 2 LC	olmo-3-32b-think-dpo	allenai	43	allenai/Olmo-3-32B-Think-DPO	69.1
Olmo-3.1-32B-Think	medium	AlpacaEval 2 LC	olmo-3-32b-think-dpo	allenai	44	allenai/Olmo-3-32B-Think-DPO	69.1
Olmo-3-32B-Think-SFT	medium	AlpacaEval 2 LC	olmo-3-1125-32b	allenai	45	allenai/Olmo-3-1125-32B	69.1
Olmo-3.1-32B-Think-GGUF	medium	AlpacaEval 2 LC	olmo-3-1-32b-think	unsloth	46	allenai/Olmo-3.1-32B-Think	69.1
Olmo-3-32B-Think-GGUF	medium	AlpacaEval 2 LC	olmo-3-32b-think-dpo	unsloth	47	allenai/Olmo-3-32B-Think	69.1
Olmo-3-32B-Think-DPO	medium	AlpacaEval 2 LC	olmo-3-32b-think-sft	allenai	48	allenai/Olmo-3-32B-Think-SFT	69.1
Olmo-3-32B-Think-unsloth-bnb-4bit	medium	AlpacaEval 2 LC	olmo-3-32b-think-dpo	unsloth	49	allenai/Olmo-3-32B-Think	69.1
Falcon-H1-34B-Instruct	medium	Alpaca-Eval	falcon-h1-34b-base	tiiuae	50	tiiuae/Falcon-H1-34B-Base	48.32
Falcon-H1-34B-Instruct-GGUF	medium	Alpaca-Eval	falcon-h1-34b-instruct	tiiuae	51	tiiuae/Falcon-H1-34B-Instruct	48.32
Falcon-H1-34B-Instruct-GGUF	medium	Alpaca-Eval	falcon-h1-34b-instruct	unsloth	52	tiiuae/Falcon-H1-34B-Instruct	48.32
Falcon-H1-34B-Instruct-GPTQ-Int4	medium	Alpaca-Eval	falcon-h1-34b-instruct	tiiuae	53	tiiuae/Falcon-H1-34B-Instruct	48.32
OLMo-7B-Instruct-hf	low	AlpacaEval %win ↑	olmo-7b-instruct-hf	allenai	54	allenai/OLMo-7B-Instruct-hf	46.8
OLMo-7B-Instruct	low	AlpacaEval %win ↑	olmo-7b-instruct	allenai	55	allenai/OLMo-7B-Instruct	46.8
OLMo-7B-SFT-hf	low	AlpacaEval %win ↑	olmo-7b-sft-hf	allenai	56	allenai/OLMo-7B-SFT-hf	46.8
OLMo-7B-SFT	low	AlpacaEval %win ↑	Unknown	allenai	57	allenai/OLMo-7B-SFT	46.8
DeepSeek-V2.5	medium	AlpacaEval 2.0	deepseek-v2-5	deepseek-ai	58	deepseek-ai/DeepSeek-V2.5	46.6
rocket-3B-GGUF	low	AlpacaEval (win rate %)	rocket-3b	TheBloke	59	pansophic/rocket-3B	45.71
OLMo-2-1124-7B-Instruct	low	AlpacaEval	Unknown	allenai	60	allenai/OLMo-2-1124-7B-DPO	43.7
OLMo-2-1124-13B-Instruct	low	AlpacaEval	olmo-2-1124-13b-instruct-rlvr2	allenai	61	allenai/OLMo-2-1124-13B-Instruct-RLVR2	43.7
OLMo-2-1124-7B-SFT	low	AlpacaEval	olmo2-7b-1124	allenai	62	allenai/OLMo2-7B-1124	43.7
OLMo-2-1124-7B-DPO	low	AlpacaEval	Unknown	allenai	63	allenai/OLMo-2-1124-7B-SFT	43.7
OLMo-2-1124-13B-SFT	low	AlpacaEval	olmo2-13b-1124	allenai	64	allenai/OLMo2-13B-1124	43.7
OLMo-2-1124-13B-DPO	low	AlpacaEval	Unknown	allenai	65	allenai/OLMo-2-1124-13B-SFT	43.7
OLMo-2-1124-7B-Instruct-preview	low	AlpacaEval	Unknown	allenai	66	allenai/OLMo-2-1124-7B-DPO	43.7
OLMo-2-1124-7B-RM	low	AlpacaEval	Unknown	allenai	67	allenai/OLMo-2-1124-7B-SFT	43.7
OLMo-2-1124-7B-RM-Preview	low	AlpacaEval	Unknown	allenai	68	allenai/OLMo-2-1124-7B-SFT	43.7
OLMo-2-1124-13B-RM	low	AlpacaEval	Unknown	allenai	69	allenai/OLMo-2-1124-13B-SFT	43.7
OLMo-2-1124-13B-Instruct-preview	low	AlpacaEval	olmo-2-1124-13b-dpo	allenai	70	allenai/OLMo-2-1124-13B-DPO	43.7
OLMo-2-1124-7B-SFT-Preview	low	AlpacaEval	olmo2-7b-1124	allenai	71	allenai/OLMo2-7B-1124	43.7
OLMo-2-1124-7B-DPO-Preview	low	AlpacaEval	Unknown	allenai	72	allenai/OLMo-2-1124-7B-SFT	43.7
Olmo-3.1-32B-Instruct	medium	AlpacaEval 2 LC	olmo-3-1-32b-instruct-dpo	allenai	73	allenai/Olmo-3.1-32B-Instruct-DPO	42.2
Olmo-3.1-32B-Instruct-SFT	medium	AlpacaEval 2 LC	olmo-3-1125-32b	allenai	74	allenai/Olmo-3-1125-32B	42.2
Olmo-3.1-32B-Instruct-DPO	medium	AlpacaEval 2 LC	olmo-3-1-32b-instruct-sft	allenai	75	allenai/Olmo-3.1-32B-Instruct-SFT	42.2
Olmo-3.1-32B-Instruct-GGUF	medium	AlpacaEval 2 LC	olmo-3-1-32b-instruct	unsloth	76	allenai/Olmo-3.1-32B-Instruct	42.2
Olmo-3.1-32B-Instruct	medium	AlpacaEval 2 LC	olmo-3-1-32b-instruct	unsloth	77	allenai/Olmo-3.1-32B-Instruct	42.2
Falcon-H1-7B-Instruct	medium	Alpaca-Eval	falcon-h1-7b-base	tiiuae	78	tiiuae/Falcon-H1-7B-Base	40.23
Falcon-H1-7B-Instruct-GPTQ-Int4	medium	Alpaca-Eval	falcon-h1-7b-instruct	tiiuae	79	tiiuae/Falcon-H1-7B-Instruct	40.23
Falcon-H1-7B-Instruct-GGUF	medium	Alpaca-Eval	falcon-h1-7b-instruct	tiiuae	80	tiiuae/Falcon-H1-7B-Instruct	40.23
Falcon-H1-7B-Instruct-GGUF	medium	Alpaca-Eval	falcon-h1-7b-instruct	unsloth	81	tiiuae/Falcon-H1-7B-Instruct	40.23
OLMo-2-0325-32B-Instruct	low	AlpacaEval 2 LC	olmo-2-0325-32b	allenai	82	allenai/OLMo-2-0325-32B-DPO	38.7
OLMo-2-0325-32B-Instruct-GGUF	low	AlpacaEval 2 LC	olmo-2-0325-32b-instruct	unsloth	83	allenai/OLMo-2-0325-32B-Instruct	38.7
OLMo-2-0325-32B-SFT	low	AlpacaEval 2 LC	olmo-2-0325-32b	allenai	84	allenai/OLMo-2-0325-32B	38.7
OLMo-2-0325-32B-DPO	low	AlpacaEval 2 LC	olmo-2-0325-32b	allenai	85	allenai/OLMo-2-0325-32B-SFT	38.7
OLMo-2-0325-32B-Instruct	low	AlpacaEval 2 LC	olmo-2-0325-32b-instruct	unsloth	86	allenai/OLMo-2-0325-32B-Instruct	38.7
Falcon-H1-3B-Instruct	medium	Alpaca-Eval	falcon-h1-3b-base	tiiuae	87	tiiuae/Falcon-H1-3B-Base	31.09
Falcon-H1-3B-Instruct-GGUF	medium	Alpaca-Eval	falcon-h1-3b-base	tiiuae	88	tiiuae/Falcon-H1-3B-Base	31.09
Falcon-H1-3B-Instruct-GGUF	medium	Alpaca-Eval	falcon-h1-3b-instruct	unsloth	89	tiiuae/Falcon-H1-3B-Instruct	31.09
Falcon-H1-1.5B-Instruct	medium	Alpaca-Eval	falcon-h1-1-5b-base	tiiuae	90	tiiuae/Falcon-H1-1.5B-Base	28.18
Falcon-H1-1.5B-Instruct-GGUF	medium	Alpaca-Eval	falcon-h1-1-5b-instruct	tiiuae	91	tiiuae/Falcon-H1-1.5B-Instruct	28.18
Falcon-H1-1.5B-Instruct-GGUF	medium	Alpaca-Eval	falcon-h1-1-5b-instruct	unsloth	92	tiiuae/Falcon-H1-1.5B-Instruct	28.18
Falcon-H1-1.5B-Instruct-GPTQ-Int4	medium	Alpaca-Eval	falcon-h1-1-5b-instruct	tiiuae	93	tiiuae/Falcon-H1-1.5B-Instruct	28.18
Falcon-H1-1.5B-Instruct-GPTQ-Int8	medium	Alpaca-Eval	falcon-h1-1-5b-instruct	tiiuae	94	tiiuae/Falcon-H1-1.5B-Instruct	28.18
Falcon-H1-1.5B-Deep-Instruct	medium	Alpaca-Eval	falcon-h1-1-5b-deep-base	tiiuae	95	tiiuae/Falcon-H1-1.5B-Deep-Base	27.12
Falcon-H1-1.5B-Deep-Instruct-GGUF	medium	Alpaca-Eval	falcon-h1-1-5b-deep-instruct	tiiuae	96	tiiuae/Falcon-H1-1.5B-Deep-Instruct	27.12
Falcon-H1-1.5B-Deep-Instruct-GGUF	medium	Alpaca-Eval	falcon-h1-1-5b-deep-instruct	unsloth	97	tiiuae/Falcon-H1-1.5B-Deep-Instruct	27.12
Falcon-H1-1.5B-Deep-Instruct	medium	Alpaca-Eval	falcon-h1-1-5b-deep-instruct	unsloth	98	tiiuae/Falcon-H1-1.5B-Deep-Instruct	27.12
Falcon-H1-1.5B-Deep-Instruct-GPTQ-Int4	medium	Alpaca-Eval	falcon-h1-1-5b-deep-instruct	tiiuae	99	tiiuae/Falcon-H1-1.5B-Deep-Instruct	27.12
OLMoE-1B-7B-0125-Instruct	medium	AlpacaEval	olmoe-1b-7b-0125-dpo	allenai	100	allenai/OLMoE-1B-7B-0125-DPO	17.99
OLMoE-1B-7B-0125-DPO	medium	AlpacaEval	olmoe-1b-7b-0125	allenai	101	allenai/OLMoE-1B-7B-0125-SFT	17.99
OLMoE-1B-7B-0125-SFT	medium	AlpacaEval	olmoe-1b-7b-0125	allenai	102	allenai/OLMoE-1B-7B-0125	17.99
Llama-3.1-Tulu-3-8B-SFT	medium	AlpacaEval 2 (LC % win)	llama-3-1-8b	allenai	103	meta-llama/Llama-3.1-8B	12.4
Llama-3.1-Tulu-3-8B	medium	AlpacaEval 2 (LC % win)	llama-3-1-tulu-3-8b-dpo	allenai	104	allenai/Llama-3.1-Tulu-3-8B-DPO	12.4
Llama-3.1-Tulu-3-8B-DPO	medium	AlpacaEval 2 (LC % win)	llama-3-1-tulu-3-8b-sft	allenai	105	allenai/Llama-3.1-Tulu-3-8B-SFT	12.4
Llama-3.1-Tulu-3-8B-RM	medium	AlpacaEval 2 (LC % win)	llama-3-1-tulu-3-8b-sft	allenai	106	allenai/Llama-3.1-Tulu-3-8B-SFT	12.4
Llama-3.1-Tulu-3.1-8B	medium	AlpacaEval 2 (LC % win)	llama-3-1-tulu-3-8b-dpo	allenai	107	allenai/Llama-3.1-Tulu-3-8B-DPO	12.4
Llama-3.1-Tulu-3-70B	medium	AlpacaEval 2 (LC % win)	llama-3-1-tulu-3-70b-dpo	allenai	108	allenai/Llama-3.1-Tulu-3-70B-DPO	12.4
Llama-3.1-Tulu-3-70B-SFT	medium	AlpacaEval 2 (LC % win)	llama-3-1-70b	allenai	109	meta-llama/Llama-3.1-70B	12.4
Llama-3.1-Tulu-3-405B	medium	AlpacaEval 2 (LC % win)	llama-3-1-405b	allenai	110	allenai/Llama-3.1-Tulu-3-405B-DPO	12.4
Llama-3.1-Tulu-3-70B-DPO	medium	AlpacaEval 2 (LC % win)	llama-3-1-tulu-3-70b-sft	allenai	111	allenai/Llama-3.1-Tulu-3-70B-SFT	12.4
Llama-3.1-Tulu-3-8B-GGUF	medium	AlpacaEval 2 (LC % win)	llama-3-1-tulu-3-8b	unsloth	112	allenai/Llama-3.1-Tulu-3-8B	12.4
Llama-3.1-Tulu-3-405B-SFT	medium	AlpacaEval 2 (LC % win)	llama-3-1-405b	allenai	113	meta-llama/Llama-3.1-405B	12.4
Llama-3.1-Tulu-3-70B-GGUF	medium	AlpacaEval 2 (LC % win)	llama-3-1-tulu-3-70b	unsloth	114	allenai/Llama-3.1-Tulu-3-70B	12.4
Llama-3.1-Tulu-3-405B-DPO	medium	AlpacaEval 2 (LC % win)	llama-3-1-405b	allenai	115	allenai/Llama-3.1-Tulu-3-405B-SFT	12.4
Falcon-H1-0.5B-Instruct	medium	Alpaca-Eval	falcon-h1-0-5b-base	tiiuae	116	tiiuae/Falcon-H1-0.5B-Base	10.79
Falcon-H1-0.5B-Instruct-GGUF	medium	Alpaca-Eval	falcon-h1-0-5b-base	tiiuae	117	tiiuae/Falcon-H1-0.5B-Base	10.79
Falcon-H1-0.5B-Instruct-GGUF	medium	Alpaca-Eval	falcon-h1-0-5b-instruct	unsloth	118	tiiuae/Falcon-H1-0.5B-Instruct	10.79
Ming-Lite-Omni-1.5	low	Average(Open-ended QA)	ming-lite-omni	inclusionAI	119	inclusionAI/Ming-Lite-Omni	4.65
LFM2.5-Audio-1.5B	high	AlpacaEval	lfm2-1-2b	LiquidAI	120	LiquidAI/LFM2-1.2B	3.76
LFM2.5-Audio-1.5B-GGUF	high	AlpacaEval	lfm2-1-2b	Mungert	121	LiquidAI/LFM2-1.2B	3.76
LFM2-Audio-1.5B	high	AlpacaEval	lfm2-1-2b	LiquidAI	122	LiquidAI/LFM2-1.2B	3.71
Ming-Lite-Omni	low	AlpacaEval	ling-lite	inclusionAI	123	inclusionAI/Ling-lite	3.69
OLMo-2-0425-1B-Instruct	low	AlpacaEval 2 LC	olmo-2-0425-1b-rlvr1	allenai	124	allenai/OLMo-2-0425-1B-RLVR1	2.4
OLMo-2-0425-1B-SFT	low	AlpacaEval 2 LC	olmo-2-0425-1b	allenai	125	allenai/OLMo-2-0425-1B	2.4
OLMo-2-0425-1B-DPO	low	AlpacaEval 2 LC	olmo-2-0425-1b	allenai	126	allenai/OLMo-2-0425-1B-SFT	2.4
OLMo-2-0425-1B-Instruct-GGUF	low	AlpacaEval 2 LC	olmo-2-0425-1b-instruct	unsloth	127	allenai/OLMo-2-0425-1B-Instruct	2.4
OLMo-2-0425-1B-Instruct	low	AlpacaEval 2 LC	olmo-2-0425-1b-instruct	unsloth	128	allenai/OLMo-2-0425-1B-Instruct	2.4
OLMo-2-0425-1B-RLVR1	low	AlpacaEval 2 LC	olmo-2-0425-1b	allenai	129	allenai/OLMo-2-0425-1B-DPO	2.4
OLMoE-1B-7B-0924-Instruct	medium	Alpaca-Eval	olmoe-1b-7b-0924-sft	allenai	130	allenai/OLMoE-1B-7B-0924-SFT	1

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/alpacaeval.html, docs/notes/hf-benchmark-contexts.json
url: huggingface.co/spaces/alpacaeval ↗