Leaderboard

BigBench

bigbench

Record

Category: reasoning
Scored models: 575

Scores

Model	Score
NousResearch/Nous-Hermes-2-SOLAR-10.7B	80.66
NousResearch/Nous-Hermes-2-Yi-34B	80.66
NousResearch/Nous-Hermes-2-Yi-34B	80.66
mlabonne/Beyonder-4x7B-v2	77.35
mlabonne/Marcoro14-7B-slerp	77.35
NousResearch/Nous-Hermes-2-SOLAR-10.7B	74.95
NousResearch/Nous-Hermes-2-Yi-34B	74.95
NousResearch/Nous-Hermes-2-Yi-34B	74.95
google/gemma-4-26B-A4B	74.4
google/gemma-4-31B	74.4
google/gemma-4-E4B	74.4
google/gemma-4-E2B	74.4
google/gemma-4-12B	74.4
google/gemma-4-31B-it-qat-q4_0-unquantized	74.4
google/gemma-4-12B-it-qat-q4_0-unquantized	74.4
google/gemma-4-31B-it-assistant	74.4
google/gemma-4-26B-A4B-it	74.4
google/gemma-4-26B-A4B	74.4
google/gemma-4-31B	74.4
google/gemma-4-12B-it	74.4
google/gemma-4-12B-it	74.4
google/gemma-4-31B-it	74.4
google/gemma-4-E4B-it	74.4
google/gemma-4-E2B-it-qat-q4_0-unquantized	74.4

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: reasoning
id: bigbench
name: BigBench
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_snarks	nous-hermes-2-solar-10-7b	TheBloke	1	NousResearch/Nous-Hermes-2-SOLAR-10.7B	80.66
Nous-Hermes-2-Yi-34B-GGUF	medium	_snarks	nous-hermes-2-yi-34b	TheBloke	2	NousResearch/Nous-Hermes-2-Yi-34B	80.66
Nous-Hermes-2-Yi-34B-AWQ	medium	_snarks	nous-hermes-2-yi-34b	TheBloke	3	NousResearch/Nous-Hermes-2-Yi-34B	80.66
Beyonder-4x7B-v2-GGUF	medium	_snarks	beyonder-4x7b-v2	TheBloke	4	mlabonne/Beyonder-4x7B-v2	77.35
Beyonder-4x7B-v2	medium	_snarks	marcoro14-7b-slerp	mlabonne	5	mlabonne/Marcoro14-7B-slerp	77.35
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_reasoning_about_colored_objects	nous-hermes-2-solar-10-7b	TheBloke	6	NousResearch/Nous-Hermes-2-SOLAR-10.7B	74.95
Nous-Hermes-2-Yi-34B-GGUF	medium	_reasoning_about_colored_objects	nous-hermes-2-yi-34b	TheBloke	7	NousResearch/Nous-Hermes-2-Yi-34B	74.95
Nous-Hermes-2-Yi-34B-AWQ	medium	_reasoning_about_colored_objects	nous-hermes-2-yi-34b	TheBloke	8	NousResearch/Nous-Hermes-2-Yi-34B	74.95
gemma-4-26B-A4B-it	medium	BigBench Extra Hard	gemma-4-26b-a4b	google	9	google/gemma-4-26B-A4B	74.4
gemma-4-31B-it	medium	BigBench Extra Hard	gemma-4-31b	google	10	google/gemma-4-31B	74.4
gemma-4-E4B-it	medium	BigBench Extra Hard	gemma-4-e4b	google	11	google/gemma-4-E4B	74.4
gemma-4-E2B-it	medium	BigBench Extra Hard	gemma-4-e2b	google	12	google/gemma-4-E2B	74.4
gemma-4-12B-it	medium	BigBench Extra Hard	gemma-4-12b	google	13	google/gemma-4-12B	74.4
gemma-4-31B-it-qat-w4a16-ct	medium	BigBench Extra Hard	gemma-4-31b-it-qat-q4-0-unquantized	google	14	google/gemma-4-31B-it-qat-q4_0-unquantized	74.4
gemma-4-12B-it-qat-w4a16-ct	medium	BigBench Extra Hard	gemma-4-12b-it-qat-q4-0-unquantized	google	15	google/gemma-4-12B-it-qat-q4_0-unquantized	74.4
gemma-4-31B-it-assistant	medium	BigBench Extra Hard	gemma-4-31b-it-assistant	google	16	google/gemma-4-31B-it-assistant	74.4
gemma-4-26B-A4B-it-GGUF	medium	BigBench Extra Hard	gemma-4-26b-a4b-it	unsloth	17	google/gemma-4-26B-A4B-it	74.4
gemma-4-26B-A4B	medium	BigBench Extra Hard	gemma-4-26b-a4b	google	18	google/gemma-4-26B-A4B	74.4
gemma-4-31B	medium	BigBench Extra Hard	gemma-4-31b	google	19	google/gemma-4-31B	74.4
gemma-4-12b-it-GGUF	medium	BigBench Extra Hard	gemma-4-12b-it	unsloth	20	google/gemma-4-12B-it	74.4
gemma-4-12B-it-qat-q4_0-unquantized	medium	BigBench Extra Hard	gemma-4-12b-it	google	21	google/gemma-4-12B-it	74.4
gemma-4-31B-it-GGUF	medium	BigBench Extra Hard	gemma-4-31b-it	unsloth	22	google/gemma-4-31B-it	74.4
gemma-4-E4B-it-GGUF	medium	BigBench Extra Hard	gemma-4-e4b-it	unsloth	23	google/gemma-4-E4B-it	74.4
gemma-4-E2B-it-qat-w4a16-ct	medium	BigBench Extra Hard	gemma-4-e2b-it-qat-q4-0-unquantized	google	24	google/gemma-4-E2B-it-qat-q4_0-unquantized	74.4
gemma-4-26B-A4B-it-qat-GGUF	medium	BigBench Extra Hard	gemma-4-26b-a4b-it-qat-q4-0-unquantized	unsloth	25	google/gemma-4-26B-A4B-it-qat-q4_0-unquantized	74.4
gemma-4-E4B-it-unsloth-bnb-4bit	medium	BigBench Extra Hard	gemma-4-e4b-it	unsloth	26	google/gemma-4-E4B-it	74.4
gemma-4-E2B-it-GGUF	medium	BigBench Extra Hard	gemma-4-e2b	unsloth	27	google/gemma-4-E2B-it	74.4
gemma-4-E4B-it-qat-w4a16-ct	medium	BigBench Extra Hard	gemma-4-e4b-it-qat-q4-0-unquantized	google	28	google/gemma-4-E4B-it-qat-q4_0-unquantized	74.4
gemma-4-31B-it-unsloth-bnb-4bit	medium	BigBench Extra Hard	gemma-4-31b-it	unsloth	29	google/gemma-4-31B-it	74.4
gemma-4-31B-it-qat-GGUF	medium	BigBench Extra Hard	gemma-4-31b-it-qat-q4-0-unquantized	unsloth	30	google/gemma-4-31B-it-qat-q4_0-unquantized	74.4
gemma-4-12B	medium	BigBench Extra Hard	gemma-4-12b	google	31	google/gemma-4-12B	74.4
gemma-4-E4B-it-qat-GGUF	medium	BigBench Extra Hard	gemma-4-e4b-it-qat-q4-0-unquantized	unsloth	32	google/gemma-4-E4B-it-qat-q4_0-unquantized	74.4
gemma-4-26B-A4B-it-assistant	medium	BigBench Extra Hard	gemma-4-26b-a4b-it-assistant	google	33	google/gemma-4-26B-A4B-it-assistant	74.4
gemma-4-12B-it-qat-GGUF	medium	BigBench Extra Hard	gemma-4-12b-it-qat-q4-0-unquantized	unsloth	34	google/gemma-4-12B-it-qat-q4_0-unquantized	74.4
gemma-4-12B-it-qat-q4_0-gguf	medium	BigBench Extra Hard	gemma-4-12b-it-qat-q4-0-unquantized	google	35	google/gemma-4-12B-it-qat-q4_0-unquantized	74.4
gemma-4-E4B	medium	BigBench Extra Hard	gemma-4-e4b	google	36	google/gemma-4-E4B	74.4
gemma-4-E4B-it-qat-q4_0-gguf	medium	BigBench Extra Hard	gemma-4-e4b-it-qat-q4-0-unquantized	google	37	google/gemma-4-E4B-it-qat-q4_0-unquantized	74.4
gemma-4-E2B-it-qat-q4_0-gguf	medium	BigBench Extra Hard	gemma-4-e2b-it-qat-q4-0-unquantized	google	38	google/gemma-4-E2B-it-qat-q4_0-unquantized	74.4
gemma-4-12B-it-assistant	medium	BigBench Extra Hard	gemma-4-12b-it-assistant	google	39	google/gemma-4-12B-it-assistant	74.4
gemma-4-E4B-it	medium	BigBench Extra Hard	gemma-4-e4b-it	unsloth	40	google/gemma-4-E4B-it	74.4
gemma-4-12b-it	medium	BigBench Extra Hard	gemma-4-12b-it	unsloth	41	google/gemma-4-12B-it	74.4
gemma-4-E2B-it-qat-GGUF	medium	BigBench Extra Hard	gemma-4-e2b-it-qat-q4-0-unquantized	unsloth	42	google/gemma-4-E2B-it-qat-q4_0-unquantized	74.4
gemma-4-12B-it-qat-q4_0-unquantized-assistant	medium	BigBench Extra Hard	gemma-4-12b-it-assistant	google	43	google/gemma-4-12B-it-assistant	74.4
gemma-4-26B-A4B-it-qat-q4_0-gguf	medium	BigBench Extra Hard	gemma-4-26b-a4b-it-qat-q4-0-unquantized	google	44	google/gemma-4-26B-A4B-it-qat-q4_0-unquantized	74.4
gemma-4-E2B	medium	BigBench Extra Hard	gemma-4-e2b	google	45	google/gemma-4-E2B	74.4
gemma-4-26B-A4B-it-NVFP4	medium	BigBench Extra Hard	gemma-4-26b-a4b-it	unsloth	46	google/gemma-4-26B-A4B-it	74.4
gemma-4-E2B-it-unsloth-bnb-4bit	medium	BigBench Extra Hard	gemma-4-e2b	unsloth	47	google/gemma-4-E2B-it	74.4
gemma-4-31B-it-qat-q4_0-gguf	medium	BigBench Extra Hard	gemma-4-31b-it-qat-q4-0-unquantized	google	48	google/gemma-4-31B-it-qat-q4_0-unquantized	74.4
gemma-4-E2B-it	medium	BigBench Extra Hard	gemma-4-e2b	unsloth	49	google/gemma-4-E2B-it	74.4
gemma-4-31B-it-qat-w4a16	medium	BigBench Extra Hard	gemma-4-31b-it-qat-q4-0-unquantized	unsloth	50	google/gemma-4-31B-it-qat-q4_0-unquantized	74.4
gemma-4-E2B-it-assistant	medium	BigBench Extra Hard	gemma-4-e2b-it-assistant	google	51	google/gemma-4-E2B-it-assistant	74.4
gemma-4-E4B-it-assistant	medium	BigBench Extra Hard	gemma-4-e4b-it-assistant	google	52	google/gemma-4-E4B-it-assistant	74.4
gemma-4-26B-A4B-it	medium	BigBench Extra Hard	gemma-4-26b-a4b-it	unsloth	53	google/gemma-4-26B-A4B-it	74.4
gemma-4-E2B-it-qat-mobile-ct	medium	BigBench Extra Hard	gemma-4-e2b-it-qat-mobile-transformers	google	54	google/gemma-4-E2B-it-qat-mobile-transformers	74.4
gemma-4-E2B-it-qat-mobile-GGUF	medium	BigBench Extra Hard	gemma-4-e2b-it-qat-mobile-transformers	unsloth	55	google/gemma-4-E2B-it-qat-mobile-transformers	74.4
gemma-4-26B-A4B-it-qat-q4_0-unquantized	medium	BigBench Extra Hard	gemma-4-26b-a4b-it	google	56	google/gemma-4-26B-A4B-it	74.4
gemma-4-E2B-it-qat-q4_0-unquantized	medium	BigBench Extra Hard	gemma-4-e2b	google	57	google/gemma-4-E2B-it	74.4
gemma-4-E4B-it-qat-mobile-ct	medium	BigBench Extra Hard	gemma-4-e4b-it-qat-mobile-transformers	google	58	google/gemma-4-E4B-it-qat-mobile-transformers	74.4
gemma-4-12b-it-NVFP4	medium	BigBench Extra Hard	gemma-4-12b-it	unsloth	59	google/gemma-4-12B-it	74.4
gemma-4-31B-it	medium	BigBench Extra Hard	gemma-4-31b-it	unsloth	60	google/gemma-4-31B-it	74.4
gemma-4-E4B-it-qat-mobile-GGUF	medium	BigBench Extra Hard	gemma-4-e4b-it-qat-mobile-transformers	unsloth	61	google/gemma-4-E4B-it-qat-mobile-transformers	74.4
gemma-4-31B-it-NVFP4	medium	BigBench Extra Hard	gemma-4-31b-it	unsloth	62	google/gemma-4-31B-it	74.4
gemma-4-12b	medium	BigBench Extra Hard	gemma-4-12b	unsloth	63	google/gemma-4-12B	74.4
gemma-4-E2B-it-qat-mobile-transformers	medium	BigBench Extra Hard	gemma-4-e2b	google	64	google/gemma-4-E2B-it	74.4
gemma-4-E4B-it-qat-mobile-transformers	medium	BigBench Extra Hard	gemma-4-e4b-it	google	65	google/gemma-4-E4B-it	74.4
gemma-4-31B-it-qat-q4_0-unquantized-assistant	medium	BigBench Extra Hard	gemma-4-31b-it-assistant	google	66	google/gemma-4-31B-it-assistant	74.4
gemma-4-E4B-it-qat-q4_0-unquantized	medium	BigBench Extra Hard	gemma-4-e4b-it	google	67	google/gemma-4-E4B-it	74.4
gemma-4-26B-A4B-it-qat-q4_0-unquantized-assistant	medium	BigBench Extra Hard	gemma-4-26b-a4b-it-assistant	google	68	google/gemma-4-26B-A4B-it-assistant	74.4
gemma-4-31B-it-qat-q4_0-unquantized	medium	BigBench Extra Hard	gemma-4-31b-it	google	69	google/gemma-4-31B-it	74.4
gemma-4-E4B-it-NVFP4	medium	BigBench Extra Hard	gemma-4-e4b-it	unsloth	70	google/gemma-4-E4B-it	74.4
gemma-4-E2B-it-qat-q4_0-unquantized-assistant	medium	BigBench Extra Hard	gemma-4-e2b-it-assistant	google	71	google/gemma-4-E2B-it-assistant	74.4
gemma-4-E4B-it-qat-q4_0-unquantized-assistant	medium	BigBench Extra Hard	gemma-4-e4b-it-assistant	google	72	google/gemma-4-E4B-it-assistant	74.4
gemma-4-12B-it-qat-q4_0-unquantized	medium	BigBench Extra Hard	gemma-4-12b-it	unsloth	73	google/gemma-4-12B-it	74.4
gemma-4-E2B	medium	BigBench Extra Hard	gemma-4-e2b	unsloth	74	google/gemma-4-E2B	74.4
gemma-4-E2B-it-qat-q4_0-unquantized	medium	BigBench Extra Hard	gemma-4-e2b	unsloth	75	google/gemma-4-E2B-it	74.4
gemma-4-E2B-it-NVFP4	medium	BigBench Extra Hard	gemma-4-e2b	unsloth	76	google/gemma-4-E2B-it	74.4
gemma-4-12B-it-qat-w4a16	medium	BigBench Extra Hard	gemma-4-12b-it-qat-q4-0-unquantized	unsloth	77	google/gemma-4-12B-it-qat-q4_0-unquantized	74.4
gemma-4-26B-A4B-it-qat-q4_0-unquantized	medium	BigBench Extra Hard	gemma-4-26b-a4b-it	unsloth	78	google/gemma-4-26B-A4B-it	74.4
gemma-4-12B-it-GGUF	medium	BigBench Extra Hard	gemma-4-12b	Mungert	79	google/gemma-4-12B	74.4
gemma-4-E4B-it-qat-w4a16	medium	BigBench Extra Hard	gemma-4-e4b-it-qat-q4-0-unquantized	unsloth	80	google/gemma-4-E4B-it-qat-q4_0-unquantized	74.4
gemma-4-26b-a4b-it-UD-MLX-4bit	medium	BigBench Extra Hard	gemma-4-26b-a4b-it	unsloth	81	google/gemma-4-26B-A4B-it	74.4
gemma-4-26B-A4B	medium	BigBench Extra Hard	gemma-4-26b-a4b	unsloth	82	google/gemma-4-26B-A4B	74.4
gemma-4-31B-it-qat-q4_0-unquantized	medium	BigBench Extra Hard	gemma-4-31b-it	unsloth	83	google/gemma-4-31B-it	74.4
gemma-4-E2B-it-qat-w4a16	medium	BigBench Extra Hard	gemma-4-e2b-it-qat-q4-0-unquantized	unsloth	84	google/gemma-4-E2B-it-qat-q4_0-unquantized	74.4
gemma-4-E4B	medium	BigBench Extra Hard	gemma-4-e4b	unsloth	85	google/gemma-4-E4B	74.4
gemma-4-E4B-it-qat-q4_0-unquantized	medium	BigBench Extra Hard	gemma-4-e4b-it	unsloth	86	google/gemma-4-E4B-it	74.4
gemma-4-31B	medium	BigBench Extra Hard	gemma-4-31b	unsloth	87	google/gemma-4-31B	74.4
gemma-4-E4B-it-UD-MLX-4bit	medium	BigBench Extra Hard	gemma-4-e4b-it	unsloth	88	google/gemma-4-E4B-it	74.4
gemma-4-E2B-it-UD-MLX-4bit	medium	BigBench Extra Hard	gemma-4-e2b	unsloth	89	google/gemma-4-E2B-it	74.4
gemma-4-31b-it-MLX-8bit	medium	BigBench Extra Hard	gemma-4-31b-it	unsloth	90	google/gemma-4-31B-it	74.4
gemma-4-26b-a4b-it-MLX-8bit	medium	BigBench Extra Hard	gemma-4-26b-a4b-it	unsloth	91	google/gemma-4-26B-A4B-it	74.4
gemma-4-31B-it-GGUF	medium	BigBench Extra Hard	gemma-4-31b	Mungert	92	google/gemma-4-31B	74.4
gemma-4-E2B-it-qat-mobile	medium	BigBench Extra Hard	gemma-4-e2b-it-qat-q4-0-unquantized	unsloth	93	google/gemma-4-E2B-it-qat-q4_0-unquantized	74.4
gemma-4-E4B-it-MLX-8bit	medium	BigBench Extra Hard	gemma-4-e4b-it	unsloth	94	google/gemma-4-E4B-it	74.4
gemma-4-31b-it-UD-MLX-4bit	medium	BigBench Extra Hard	gemma-4-31b-it	unsloth	95	google/gemma-4-31B-it	74.4
gemma-4-E4B-it-GGUF	medium	BigBench Extra Hard	gemma-4-e4b	Mungert	96	google/gemma-4-E4B	74.4
gemma-4-E2B-it-GGUF	medium	BigBench Extra Hard	gemma-4-e2b	Mungert	97	google/gemma-4-E2B	74.4
gemma-4-E2B-it-MLX-8bit	medium	BigBench Extra Hard	gemma-4-e2b	unsloth	98	google/gemma-4-E2B-it	74.4
gemma-4-26b-a4b-it-UD-MLX-3bit	medium	BigBench Extra Hard	gemma-4-26b-a4b-it	unsloth	99	google/gemma-4-26B-A4B-it	74.4
gemma-4-E4B-it-qat-mobile	medium	BigBench Extra Hard	gemma-4-e4b-it-qat-q4-0-unquantized	unsloth	100	google/gemma-4-E4B-it-qat-q4_0-unquantized	74.4
gemma-4-31b-it-UD-MLX-3bit	medium	BigBench Extra Hard	gemma-4-31b-it	unsloth	101	google/gemma-4-31B-it	74.4
OpenHermes-2-Mistral-7B-GGUF	medium	_snarks	mistral-7b-v0-1	TheBloke	102	teknium/OpenHermes-2-Mistral-7B	74.03
OpenHermes-2-Mistral-7B-AWQ	medium	_snarks	mistral-7b-v0-1	TheBloke	103	teknium/OpenHermes-2-Mistral-7B	74.03
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_temporal_sequences	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	104	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	74
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_temporal_sequences	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	105	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	74
Nous-Hermes-Llama2-70B-GGUF	medium	_sports_understanding	Unknown	TheBloke	106	NousResearch/Nous-Hermes-Llama2-70b	73.94
Marcoro14-7B-slerp	medium	_sports_understanding	marcoro14-7b-slerp	mlabonne	107	AIDC-ai-business/Marcoroni-7B-v3	73.63
Nous-Hermes-Llama2-70B-GGUF	medium	_date_understanding	Unknown	TheBloke	108	NousResearch/Nous-Hermes-Llama2-70b	73.44
Beyonder-4x7B-v2-GGUF	medium	_sports_understanding	beyonder-4x7b-v2	TheBloke	109	mlabonne/Beyonder-4x7B-v2	73.02
Beyonder-4x7B-v2	medium	_sports_understanding	marcoro14-7b-slerp	mlabonne	110	mlabonne/Marcoro14-7B-slerp	73.02
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_snarks	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	111	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	72.93
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_snarks	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	112	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	72.93
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_date_understanding	nous-hermes-2-solar-10-7b	TheBloke	113	NousResearch/Nous-Hermes-2-SOLAR-10.7B	72.63
Nous-Hermes-2-Yi-34B-GGUF	medium	_date_understanding	nous-hermes-2-yi-34b	TheBloke	114	NousResearch/Nous-Hermes-2-Yi-34B	72.63
Nous-Hermes-2-Yi-34B-AWQ	medium	_date_understanding	nous-hermes-2-yi-34b	TheBloke	115	NousResearch/Nous-Hermes-2-Yi-34B	72.63
DPOpenHermes-7B-GGUF	medium	_snarks	dpopenhermes-7b	TheBloke	116	openaccess-ai-collective/DPOpenHermes-7B	72.38
Marcoro14-7B-slerp	medium	_snarks	marcoro14-7b-slerp	mlabonne	117	AIDC-ai-business/Marcoroni-7B-v3	72.38
Marcoro14-7B-slerp	medium	_reasoning_about_colored_objects	marcoro14-7b-slerp	mlabonne	118	AIDC-ai-business/Marcoroni-7B-v3	72.15
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_date_understanding	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	119	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	71.82
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_date_understanding	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	120	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	71.82
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_date_understanding	nous-hermes-2-mixtral-8x7b-sft	TheBloke	121	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	71.54
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_snarks	nous-hermes-2-mixtral-8x7b-sft	TheBloke	122	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	71.27
Redmond-Puffin-13B-GGUF	medium	_date_understanding	Unknown	TheBloke	123	NousResearch/Redmond-Puffin-13B	71.27
Redmond-Puffin-13B-GPTQ	medium	_date_understanding	Unknown	TheBloke	124	NousResearch/Redmond-Puffin-13B	71.27
NeuralHermes-2.5-Mistral-7B-laser	medium	_snarks	openhermes-2-5-mistral-7b	mlabonne	125	teknium/OpenHermes-2.5-Mistral-7B	70.72
DPOpenHermes-7B-v2-GGUF	medium	_snarks	dpopenhermes-7b-v2	TheBloke	126	openaccess-ai-collective/DPOpenHermes-7B-v2	70.17
DPOpenHermes-7B-GGUF	medium	_reasoning_about_colored_objects	dpopenhermes-7b	TheBloke	127	openaccess-ai-collective/DPOpenHermes-7B	69.8
Beyonder-4x7B-v2-GGUF	medium	_reasoning_about_colored_objects	beyonder-4x7b-v2	TheBloke	128	mlabonne/Beyonder-4x7B-v2	69.75
Beyonder-4x7B-v2	medium	_reasoning_about_colored_objects	marcoro14-7b-slerp	mlabonne	129	mlabonne/Marcoro14-7B-slerp	69.75
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_reasoning_about_colored_objects	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	130	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	69
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_reasoning_about_colored_objects	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	131	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	69
DPOpenHermes-7B-GGUF	medium	_sports_understanding	dpopenhermes-7b	TheBloke	132	openaccess-ai-collective/DPOpenHermes-7B	68.76
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_temporal_sequences	nous-hermes-2-mixtral-8x7b-sft	TheBloke	133	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	68.6
gemma-2-9b-it	medium	[BIG-Bench][big-bench]	gemma-2-9b	google	134	google/gemma-2-9b	68.2
gemma-2-27b-it	medium	[BIG-Bench][big-bench]	gemma-2-27b	google	135	google/gemma-2-27b	68.2
gemma-2-9b	medium	[BIG-Bench][big-bench]	gemma-2-9b	google	136	google/gemma-2-9b	68.2
gemma-2-27b	medium	[BIG-Bench][big-bench]	gemma-2-27b	google	137	google/gemma-2-27b	68.2
OpenHermes-2-Mistral-7B-GGUF	medium	_reasoning_about_colored_objects	mistral-7b-v0-1	TheBloke	138	teknium/OpenHermes-2-Mistral-7B	68.15
DPOpenHermes-7B-v2-GGUF	medium	_sports_understanding	dpopenhermes-7b-v2	TheBloke	139	openaccess-ai-collective/DPOpenHermes-7B-v2	68.15
OpenHermes-2-Mistral-7B-AWQ	medium	_reasoning_about_colored_objects	mistral-7b-v0-1	TheBloke	140	teknium/OpenHermes-2-Mistral-7B	68.15
OpenHermes-2.5-Mistral-7B-AWQ	medium	_snarks	openhermes-2-5-mistral-7b	TheBloke	141	teknium/OpenHermes-2.5-Mistral-7B	67.96
OpenHermes-2.5-Mistral-7B-GGUF	medium	_snarks	openhermes-2-5-mistral-7b	TheBloke	142	teknium/OpenHermes-2.5-Mistral-7B	67.96
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_snarks	Unknown	TheBloke	143	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	67.96
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_snarks	openhermes-2-5-mistral-7b	TheBloke	144	teknium/OpenHermes-2.5-Mistral-7B	67.96
Tulpar-7B-v0-GGUF	medium	_hyperbaton	Unknown	TheBloke	145	HyperbeeAI/Tulpar-7b-v0	67.54
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_sports_understanding	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	146	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	67.44
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_sports_understanding	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	147	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	67.44
DPOpenHermes-7B-v2-GGUF	medium	_reasoning_about_colored_objects	dpopenhermes-7b-v2	TheBloke	148	openaccess-ai-collective/DPOpenHermes-7B-v2	67.25
OpenHermes-2-Mistral-7B-GGUF	medium	_date_understanding	mistral-7b-v0-1	TheBloke	149	teknium/OpenHermes-2-Mistral-7B	66.94
OpenHermes-2-Mistral-7B-AWQ	medium	_date_understanding	mistral-7b-v0-1	TheBloke	150	teknium/OpenHermes-2-Mistral-7B	66.94
OpenHermes-2.5-Mistral-7B-AWQ	medium	_date_understanding	openhermes-2-5-mistral-7b	TheBloke	151	teknium/OpenHermes-2.5-Mistral-7B	66.67
OpenHermes-2.5-Mistral-7B-GGUF	medium	_date_understanding	openhermes-2-5-mistral-7b	TheBloke	152	teknium/OpenHermes-2.5-Mistral-7B	66.67
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_date_understanding	Unknown	TheBloke	153	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	66.67
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_date_understanding	openhermes-2-5-mistral-7b	TheBloke	154	teknium/OpenHermes-2.5-Mistral-7B	66.67
DPOpenHermes-7B-GGUF	medium	_date_understanding	dpopenhermes-7b	TheBloke	155	openaccess-ai-collective/DPOpenHermes-7B	66.67
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_reasoning_about_colored_objects	nous-hermes-2-mixtral-8x7b-sft	TheBloke	156	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	66.65
OpenHermes-2-Mistral-7B-GGUF	medium	_sports_understanding	mistral-7b-v0-1	TheBloke	157	teknium/OpenHermes-2-Mistral-7B	66.63
OpenHermes-2-Mistral-7B-AWQ	medium	_sports_understanding	mistral-7b-v0-1	TheBloke	158	teknium/OpenHermes-2-Mistral-7B	66.63
Marcoro14-7B-slerp	medium	_date_understanding	marcoro14-7b-slerp	mlabonne	159	AIDC-ai-business/Marcoroni-7B-v3	66.4
Beyonder-4x7B-v2-GGUF	medium	_date_understanding	beyonder-4x7b-v2	TheBloke	160	mlabonne/Beyonder-4x7B-v2	66.4
Beyonder-4x7B-v2	medium	_date_understanding	marcoro14-7b-slerp	mlabonne	161	mlabonne/Marcoro14-7B-slerp	66.4
OpenHermes-2.5-Mistral-7B-AWQ	medium	_reasoning_about_colored_objects	openhermes-2-5-mistral-7b	TheBloke	162	teknium/OpenHermes-2.5-Mistral-7B	66.3
OpenHermes-2.5-Mistral-7B-GGUF	medium	_reasoning_about_colored_objects	openhermes-2-5-mistral-7b	TheBloke	163	teknium/OpenHermes-2.5-Mistral-7B	66.3
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_reasoning_about_colored_objects	Unknown	TheBloke	164	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	66.3
Nous-Hermes-Llama2-70B-GGUF	medium	_snarks	Unknown	TheBloke	165	NousResearch/Nous-Hermes-Llama2-70b	66.3
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_reasoning_about_colored_objects	openhermes-2-5-mistral-7b	TheBloke	166	teknium/OpenHermes-2.5-Mistral-7B	66.3
Nous-Hermes-Llama2-70B-GGUF	medium	_reasoning_about_colored_objects	Unknown	TheBloke	167	NousResearch/Nous-Hermes-Llama2-70b	66.05
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_sports_understanding	nous-hermes-2-mixtral-8x7b-sft	TheBloke	168	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	65.92
Nous-Hermes-Llama2-70B-GGUF	medium	_causal_judgement	Unknown	TheBloke	169	NousResearch/Nous-Hermes-Llama2-70b	65.79
NeuralHermes-2.5-Mistral-7B-laser	medium	_sports_understanding	openhermes-2-5-mistral-7b	mlabonne	170	teknium/OpenHermes-2.5-Mistral-7B	65.72
DPOpenHermes-7B-v2-GGUF	medium	_date_understanding	dpopenhermes-7b-v2	TheBloke	171	openaccess-ai-collective/DPOpenHermes-7B-v2	65.31
NeuralHermes-2.5-Mistral-7B-laser	medium	_date_understanding	openhermes-2-5-mistral-7b	mlabonne	172	teknium/OpenHermes-2.5-Mistral-7B	65.31
NeuralHermes-2.5-Mistral-7B-laser	medium	_reasoning_about_colored_objects	openhermes-2-5-mistral-7b	mlabonne	173	teknium/OpenHermes-2.5-Mistral-7B	65
OpenHermes-2.5-Mistral-7B-AWQ	medium	_sports_understanding	openhermes-2-5-mistral-7b	TheBloke	174	teknium/OpenHermes-2.5-Mistral-7B	64.91
OpenHermes-2.5-Mistral-7B-GGUF	medium	_sports_understanding	openhermes-2-5-mistral-7b	TheBloke	175	teknium/OpenHermes-2.5-Mistral-7B	64.91
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_sports_understanding	Unknown	TheBloke	176	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	64.91
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_sports_understanding	openhermes-2-5-mistral-7b	TheBloke	177	teknium/OpenHermes-2.5-Mistral-7B	64.91
Tulpar-7B-v0-GGUF	medium	_date_understanding	Unknown	TheBloke	178	HyperbeeAI/Tulpar-7b-v0	64.23
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_ruin_names	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	179	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	63.17
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_ruin_names	nous-hermes-2-mixtral-8x7b-sft	TheBloke	180	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	63.17
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_ruin_names	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	181	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	63.17
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_causal_judgement	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	182	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	61.05
Tulpar-7B-v0-GGUF	medium	_causal_judgement	Unknown	TheBloke	183	HyperbeeAI/Tulpar-7b-v0	61.05
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_causal_judgement	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	184	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	61.05
Tulpar-7B-v0-GGUF	medium	_snarks	Unknown	TheBloke	185	HyperbeeAI/Tulpar-7b-v0	60.22
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_ruin_names	nous-hermes-2-solar-10-7b	TheBloke	186	NousResearch/Nous-Hermes-2-SOLAR-10.7B	59.38
Nous-Hermes-2-Yi-34B-GGUF	medium	_ruin_names	nous-hermes-2-yi-34b	TheBloke	187	NousResearch/Nous-Hermes-2-Yi-34B	59.38
Nous-Hermes-2-Yi-34B-AWQ	medium	_ruin_names	nous-hermes-2-yi-34b	TheBloke	188	NousResearch/Nous-Hermes-2-Yi-34B	59.38
Beyonder-4x7B-v2-GGUF	medium	_causal_judgement	beyonder-4x7b-v2	TheBloke	189	mlabonne/Beyonder-4x7B-v2	58.95
Beyonder-4x7B-v2	medium	_causal_judgement	marcoro14-7b-slerp	mlabonne	190	mlabonne/Marcoro14-7B-slerp	58.95
OpenHermes-2-Mistral-7B-GGUF	medium	_causal_judgement	mistral-7b-v0-1	TheBloke	191	teknium/OpenHermes-2-Mistral-7B	57.89
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_causal_judgement	nous-hermes-2-mixtral-8x7b-sft	TheBloke	192	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	57.89
OpenHermes-2-Mistral-7B-AWQ	medium	_causal_judgement	mistral-7b-v0-1	TheBloke	193	teknium/OpenHermes-2-Mistral-7B	57.89
Tulpar-7B-v0-GGUF	medium	_reasoning_about_colored_objects	Unknown	TheBloke	194	HyperbeeAI/Tulpar-7b-v0	57.5
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_causal_judgement	nous-hermes-2-solar-10-7b	TheBloke	195	NousResearch/Nous-Hermes-2-SOLAR-10.7B	57.37
Nous-Hermes-2-Yi-34B-GGUF	medium	_causal_judgement	nous-hermes-2-yi-34b	TheBloke	196	NousResearch/Nous-Hermes-2-Yi-34B	57.37
Nous-Hermes-2-Yi-34B-AWQ	medium	_causal_judgement	nous-hermes-2-yi-34b	TheBloke	197	NousResearch/Nous-Hermes-2-Yi-34B	57.37
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_disambiguation_qa	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	198	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	57.36
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_disambiguation_qa	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	199	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	57.36
DPOpenHermes-7B-GGUF	medium	_causal_judgement	dpopenhermes-7b	TheBloke	200	openaccess-ai-collective/DPOpenHermes-7B	56.84
DPOpenHermes-7B-v2-GGUF	medium	_causal_judgement	dpopenhermes-7b-v2	TheBloke	201	openaccess-ai-collective/DPOpenHermes-7B-v2	56.32
Marcoro14-7B-slerp	medium	_causal_judgement	marcoro14-7b-slerp	mlabonne	202	AIDC-ai-business/Marcoroni-7B-v3	56.32
Beyonder-4x7B-v2-GGUF	medium	_ruin_names	beyonder-4x7b-v2	TheBloke	203	mlabonne/Beyonder-4x7B-v2	55.36
Beyonder-4x7B-v2	medium	_ruin_names	marcoro14-7b-slerp	mlabonne	204	mlabonne/Marcoro14-7B-slerp	55.36
Redmond-Puffin-13B-GGUF	medium	_reasoning_about_colored_objects	Unknown	TheBloke	205	NousResearch/Redmond-Puffin-13B	54.3
Redmond-Puffin-13B-GPTQ	medium	_reasoning_about_colored_objects	Unknown	TheBloke	206	NousResearch/Redmond-Puffin-13B	54.3
Marcoro14-7B-slerp	medium	_navigate	marcoro14-7b-slerp	mlabonne	207	AIDC-ai-business/Marcoroni-7B-v3	53.9
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_disambiguation_qa	nous-hermes-2-mixtral-8x7b-sft	TheBloke	208	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	53.88
Redmond-Puffin-13B-GGUF	medium	_causal_judgement	Unknown	TheBloke	209	NousResearch/Redmond-Puffin-13B	53.68
Redmond-Puffin-13B-GPTQ	medium	_causal_judgement	Unknown	TheBloke	210	NousResearch/Redmond-Puffin-13B	53.68
OpenHermes-2.5-Mistral-7B-AWQ	medium	_causal_judgement	openhermes-2-5-mistral-7b	TheBloke	211	teknium/OpenHermes-2.5-Mistral-7B	53.16
OpenHermes-2.5-Mistral-7B-GGUF	medium	_causal_judgement	openhermes-2-5-mistral-7b	TheBloke	212	teknium/OpenHermes-2.5-Mistral-7B	53.16
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_causal_judgement	Unknown	TheBloke	213	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	53.16
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_causal_judgement	openhermes-2-5-mistral-7b	TheBloke	214	teknium/OpenHermes-2.5-Mistral-7B	53.16
NeuralHermes-2.5-Mistral-7B-laser	medium	_causal_judgement	openhermes-2-5-mistral-7b	mlabonne	215	teknium/OpenHermes-2.5-Mistral-7B	53.16
Redmond-Hermes-Coder-GPTQ	medium	_snarks	Unknown	TheBloke	216	—	52.49
Marcoro14-7B-slerp	medium	_ruin_names	marcoro14-7b-slerp	mlabonne	217	AIDC-ai-business/Marcoroni-7B-v3	52.46
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_logical_deduction_three_objects	nous-hermes-2-mixtral-8x7b-sft	TheBloke	218	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	52.33
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_tracking_shuffled_objects_three_objects	nous-hermes-2-mixtral-8x7b-sft	TheBloke	219	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	52.33
Marcoro14-7B-slerp	medium	_logical_deduction_three_objects	marcoro14-7b-slerp	mlabonne	220	AIDC-ai-business/Marcoroni-7B-v3	52.33
Marcoro14-7B-slerp	medium	_tracking_shuffled_objects_three_objects	marcoro14-7b-slerp	mlabonne	221	AIDC-ai-business/Marcoroni-7B-v3	52.33
Redmond-Hermes-Coder-GPTQ	medium	_date_understanding	Unknown	TheBloke	222	—	52.3
Beyonder-4x7B-v2-GGUF	medium	_navigate	beyonder-4x7b-v2	TheBloke	223	mlabonne/Beyonder-4x7B-v2	52.1
Beyonder-4x7B-v2	medium	_navigate	marcoro14-7b-slerp	mlabonne	224	mlabonne/Marcoro14-7B-slerp	52.1
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_movie_recommendation	nous-hermes-2-solar-10-7b	TheBloke	225	NousResearch/Nous-Hermes-2-SOLAR-10.7B	52
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_logical_deduction_three_objects	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	226	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	52
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_tracking_shuffled_objects_three_objects	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	227	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	52
Nous-Hermes-2-Yi-34B-GGUF	medium	_movie_recommendation	nous-hermes-2-yi-34b	TheBloke	228	NousResearch/Nous-Hermes-2-Yi-34B	52
Nous-Hermes-2-Yi-34B-AWQ	medium	_movie_recommendation	nous-hermes-2-yi-34b	TheBloke	229	NousResearch/Nous-Hermes-2-Yi-34B	52
Beyonder-4x7B-v2-GGUF	medium	_logical_deduction_three_objects	beyonder-4x7b-v2	TheBloke	230	mlabonne/Beyonder-4x7B-v2	52
Beyonder-4x7B-v2-GGUF	medium	_tracking_shuffled_objects_three_objects	beyonder-4x7b-v2	TheBloke	231	mlabonne/Beyonder-4x7B-v2	52
Beyonder-4x7B-v2	medium	_logical_deduction_three_objects	marcoro14-7b-slerp	mlabonne	232	mlabonne/Marcoro14-7B-slerp	52
Beyonder-4x7B-v2	medium	_tracking_shuffled_objects_three_objects	marcoro14-7b-slerp	mlabonne	233	mlabonne/Marcoro14-7B-slerp	52
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_logical_deduction_three_objects	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	234	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	52
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_tracking_shuffled_objects_three_objects	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	235	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	52
Redmond-Hermes-Coder-GPTQ	medium	_causal_judgement	Unknown	TheBloke	236	—	51.58
Tulpar-7B-v0-GGUF	medium	_sports_understanding	Unknown	TheBloke	237	HyperbeeAI/Tulpar-7b-v0	51.22
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_sports_understanding	nous-hermes-2-solar-10-7b	TheBloke	238	NousResearch/Nous-Hermes-2-SOLAR-10.7B	51.01
Nous-Hermes-2-Yi-34B-GGUF	medium	_sports_understanding	nous-hermes-2-yi-34b	TheBloke	239	NousResearch/Nous-Hermes-2-Yi-34B	51.01
Nous-Hermes-2-Yi-34B-AWQ	medium	_sports_understanding	nous-hermes-2-yi-34b	TheBloke	240	NousResearch/Nous-Hermes-2-Yi-34B	51.01
Redmond-Puffin-13B-GGUF	medium	_snarks	Unknown	TheBloke	241	NousResearch/Redmond-Puffin-13B	50.83
Redmond-Puffin-13B-GPTQ	medium	_snarks	Unknown	TheBloke	242	NousResearch/Redmond-Puffin-13B	50.83
DPOpenHermes-7B-GGUF	medium	_logical_deduction_three_objects	dpopenhermes-7b	TheBloke	243	openaccess-ai-collective/DPOpenHermes-7B	50.67
DPOpenHermes-7B-GGUF	medium	_tracking_shuffled_objects_three_objects	dpopenhermes-7b	TheBloke	244	openaccess-ai-collective/DPOpenHermes-7B	50.67
NeuralMonarch-7B	low	Bigbench	monarch-7b	mlabonne	245	mlabonne/Monarch-7B	50.28
Beyonder-4x7B-v3	low	Bigbench	alphamonarch-7b	mlabonne	246	mlabonne/AlphaMonarch-7B	50.2
AlphaMonarch-7B	low	Bigbench	neuralmonarch-7b	mlabonne	247	mlabonne/NeuralMonarch-7B	50.2
Beyonder-4x7B-v3-GGUF	low	Bigbench	alphamonarch-7b	mlabonne	248	mlabonne/AlphaMonarch-7B	50.2
Zebrafish-7B	low	Bigbench	m7-7b	mlabonne	249	liminerity/M7-7b	50.2
Monarch-7B	low	Bigbench	omnitruthybeagle-7b-v0	mlabonne	250	mlabonne/OmniTruthyBeagle-7B-v0	50.14
OpenHermes-2-Mistral-7B-GGUF	medium	_navigate	mistral-7b-v0-1	TheBloke	251	teknium/OpenHermes-2-Mistral-7B	50.1
OpenHermes-2-Mistral-7B-AWQ	medium	_navigate	mistral-7b-v0-1	TheBloke	252	teknium/OpenHermes-2-Mistral-7B	50.1
Tulpar-7B-v0-GGUF	medium	_formal_fallacies_syllogisms_negation	Unknown	TheBloke	253	HyperbeeAI/Tulpar-7b-v0	50.02
OpenHermes-2.5-Mistral-7B-AWQ	medium	_navigate	openhermes-2-5-mistral-7b	TheBloke	254	teknium/OpenHermes-2.5-Mistral-7B	50
OpenHermes-2.5-Mistral-7B-GGUF	medium	_navigate	openhermes-2-5-mistral-7b	TheBloke	255	teknium/OpenHermes-2.5-Mistral-7B	50
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_navigate	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	256	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	50
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_navigate	Unknown	TheBloke	257	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	50
Nous-Hermes-Llama2-70B-GGUF	medium	_navigate	Unknown	TheBloke	258	NousResearch/Nous-Hermes-Llama2-70b	50
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_navigate	openhermes-2-5-mistral-7b	TheBloke	259	teknium/OpenHermes-2.5-Mistral-7B	50
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_navigate	nous-hermes-2-mixtral-8x7b-sft	TheBloke	260	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	50
Tulpar-7B-v0-GGUF	medium	_navigate	Unknown	TheBloke	261	HyperbeeAI/Tulpar-7b-v0	50
Redmond-Puffin-13B-GGUF	medium	_navigate	Unknown	TheBloke	262	NousResearch/Redmond-Puffin-13B	50
DPOpenHermes-7B-GGUF	medium	_navigate	dpopenhermes-7b	TheBloke	263	openaccess-ai-collective/DPOpenHermes-7B	50
DPOpenHermes-7B-v2-GGUF	medium	_navigate	dpopenhermes-7b-v2	TheBloke	264	openaccess-ai-collective/DPOpenHermes-7B-v2	50
NeuralHermes-2.5-Mistral-7B-laser	medium	_navigate	openhermes-2-5-mistral-7b	mlabonne	265	teknium/OpenHermes-2.5-Mistral-7B	50
Redmond-Puffin-13B-GPTQ	medium	_navigate	Unknown	TheBloke	266	NousResearch/Redmond-Puffin-13B	50
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_navigate	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	267	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	50
Redmond-Puffin-13B-GGUF	medium	_sports_understanding	Unknown	TheBloke	268	NousResearch/Redmond-Puffin-13B	49.7
Redmond-Puffin-13B-GPTQ	medium	_sports_understanding	Unknown	TheBloke	269	NousResearch/Redmond-Puffin-13B	49.7
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_navigate	nous-hermes-2-solar-10-7b	TheBloke	270	NousResearch/Nous-Hermes-2-SOLAR-10.7B	49.1
Nous-Hermes-2-Yi-34B-GGUF	medium	_navigate	nous-hermes-2-yi-34b	TheBloke	271	NousResearch/Nous-Hermes-2-Yi-34B	49.1
Nous-Hermes-2-Yi-34B-AWQ	medium	_navigate	nous-hermes-2-yi-34b	TheBloke	272	NousResearch/Nous-Hermes-2-Yi-34B	49.1
Beyonder-4x7B-v2-GGUF	medium	_disambiguation_qa	beyonder-4x7b-v2	TheBloke	273	mlabonne/Beyonder-4x7B-v2	48.84
Beyonder-4x7B-v2	medium	_disambiguation_qa	marcoro14-7b-slerp	mlabonne	274	mlabonne/Marcoro14-7B-slerp	48.84
NeuralDaredevil-7B	low	Bigbench	daredevil-7b	mlabonne	275	mlabonne/Daredevil-7B	48.52
NeuralHermes-2.5-Mistral-7B-laser	medium	_logical_deduction_three_objects	openhermes-2-5-mistral-7b	mlabonne	276	teknium/OpenHermes-2.5-Mistral-7B	48.33
NeuralHermes-2.5-Mistral-7B-laser	medium	_tracking_shuffled_objects_three_objects	openhermes-2-5-mistral-7b	mlabonne	277	teknium/OpenHermes-2.5-Mistral-7B	48.33
Redmond-Hermes-Coder-GPTQ	medium	_navigate	Unknown	TheBloke	278	—	48.3
Redmond-Hermes-Coder-GPTQ	medium	_sports_understanding	Unknown	TheBloke	279	—	48.17
OpenHermes-2.5-Mistral-7B-AWQ	medium	_logical_deduction_three_objects	openhermes-2-5-mistral-7b	TheBloke	280	teknium/OpenHermes-2.5-Mistral-7B	48
OpenHermes-2.5-Mistral-7B-AWQ	medium	_tracking_shuffled_objects_three_objects	openhermes-2-5-mistral-7b	TheBloke	281	teknium/OpenHermes-2.5-Mistral-7B	48
OpenHermes-2.5-Mistral-7B-GGUF	medium	_logical_deduction_three_objects	openhermes-2-5-mistral-7b	TheBloke	282	teknium/OpenHermes-2.5-Mistral-7B	48
OpenHermes-2.5-Mistral-7B-GGUF	medium	_tracking_shuffled_objects_three_objects	openhermes-2-5-mistral-7b	TheBloke	283	teknium/OpenHermes-2.5-Mistral-7B	48
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_logical_deduction_three_objects	Unknown	TheBloke	284	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	48
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_tracking_shuffled_objects_three_objects	Unknown	TheBloke	285	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	48
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_logical_deduction_three_objects	openhermes-2-5-mistral-7b	TheBloke	286	teknium/OpenHermes-2.5-Mistral-7B	48
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_tracking_shuffled_objects_three_objects	openhermes-2-5-mistral-7b	TheBloke	287	teknium/OpenHermes-2.5-Mistral-7B	48
NeuralBeagle14-7B-GGUF	low	Bigbench	neuralbeagle14-7b	TheBloke	288	mlabonne/NeuralBeagle14-7B	47.86
NeuralBeagle14-7B-GGUF	low	Bigbench	neuralbeagle14-7b	mlabonne	289	mlabonne/NeuralBeagle14-7B	47.86
NeuralBeagle14-7B	low	Bigbench	beagle14-7b	mlabonne	290	mlabonne/Beagle14-7B	47.86
DPOpenHermes-7B-v2-GGUF	medium	_logical_deduction_three_objects	dpopenhermes-7b-v2	TheBloke	291	openaccess-ai-collective/DPOpenHermes-7B-v2	47.67
DPOpenHermes-7B-v2-GGUF	medium	_tracking_shuffled_objects_three_objects	dpopenhermes-7b-v2	TheBloke	292	openaccess-ai-collective/DPOpenHermes-7B-v2	47.67
diffusiongemma-26B-A4B-it	medium	BigBench Extra Hard	diffusiongemma-26b-a4b	google	293	google/diffusiongemma-26B-A4B-it	47.6
diffusiongemma-26B-A4B-it-GGUF	medium	BigBench Extra Hard	diffusiongemma-26b-a4b	unsloth	294	google/diffusiongemma-26B-A4B-it	47.6
diffusiongemma-26B-A4B-it	medium	BigBench Extra Hard	diffusiongemma-26b-a4b	unsloth	295	google/diffusiongemma-26B-A4B-it	47.6
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_logical_deduction_three_objects	nous-hermes-2-solar-10-7b	TheBloke	296	NousResearch/Nous-Hermes-2-SOLAR-10.7B	47.33
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_tracking_shuffled_objects_three_objects	nous-hermes-2-solar-10-7b	TheBloke	297	NousResearch/Nous-Hermes-2-SOLAR-10.7B	47.33
Nous-Hermes-2-Yi-34B-GGUF	medium	_logical_deduction_three_objects	nous-hermes-2-yi-34b	TheBloke	298	NousResearch/Nous-Hermes-2-Yi-34B	47.33
Nous-Hermes-2-Yi-34B-GGUF	medium	_tracking_shuffled_objects_three_objects	nous-hermes-2-yi-34b	TheBloke	299	NousResearch/Nous-Hermes-2-Yi-34B	47.33
Nous-Hermes-2-Yi-34B-AWQ	medium	_logical_deduction_three_objects	nous-hermes-2-yi-34b	TheBloke	300	NousResearch/Nous-Hermes-2-Yi-34B	47.33
Nous-Hermes-2-Yi-34B-AWQ	medium	_tracking_shuffled_objects_three_objects	nous-hermes-2-yi-34b	TheBloke	301	NousResearch/Nous-Hermes-2-Yi-34B	47.33
Beagle14-7B	low	Bigbench	una-thebeagle-7b-v1	mlabonne	302	fblgit/UNA-TheBeagle-7b-v1	47.25
Daredevil-7B	low	Bigbench	mistral-7b-v0-1	mlabonne	303	mistralai/Mistral-7B-v0.1	47.07
NeuralMarcoro14-7B	low	Bigbench	marcoro14-7b-slerp	mlabonne	304	mlabonne/Marcoro14-7B-slerp	46.9
NeuralDaredevil-8B-abliterated	low	Bigbench	daredevil-8b-abliterated	mlabonne	305	mlabonne/Daredevil-8B-abliterated	46.8
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_geometric_shapes	nous-hermes-2-mixtral-8x7b-sft	TheBloke	306	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	46.8
Beyonder-4x7B-v2-GGUF	medium	_temporal_sequences	beyonder-4x7b-v2	TheBloke	307	mlabonne/Beyonder-4x7B-v2	46.8
Beyonder-4x7B-v2	medium	_temporal_sequences	marcoro14-7b-slerp	mlabonne	308	mlabonne/Marcoro14-7B-slerp	46.8
Daredevil-8B-abliterated	low	Bigbench	daredevil-8b	mlabonne	309	mlabonne/Daredevil-8B	46.77
Daredevil-8B	low	Bigbench	llama-3-stella-8b	mlabonne	310	nbeerbower/llama-3-stella-8B	46.77
Beyonder-4x7B-v2-GGUF	low	Bigbench	beyonder-4x7b-v2	TheBloke	311	mlabonne/Beyonder-4x7B-v2	46.4
Beyonder-4x7B-v2	low	Bigbench	marcoro14-7b-slerp	mlabonne	312	mlabonne/Marcoro14-7B-slerp	46.4
NeuralHermes-2.5-Mistral-7B-laser	medium	_ruin_names	openhermes-2-5-mistral-7b	mlabonne	313	teknium/OpenHermes-2.5-Mistral-7B	46.21
Nous-Hermes-Llama2-70B-GGUF	medium	_ruin_names	Unknown	TheBloke	314	NousResearch/Nous-Hermes-Llama2-70b	45.98
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_geometric_shapes	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	315	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	45.96
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_geometric_shapes	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	316	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	45.96
Marcoro14-7B-slerp	medium	_temporal_sequences	marcoro14-7b-slerp	mlabonne	317	AIDC-ai-business/Marcoroni-7B-v3	45.7
Marcoro14-7B-slerp	high	Bigbench	marcoro14-7b-slerp	mlabonne	318	AIDC-ai-business/Marcoroni-7B-v3	45.64
Marcoro14-7B-slerp	medium	_disambiguation_qa	marcoro14-7b-slerp	mlabonne	319	AIDC-ai-business/Marcoroni-7B-v3	45.35
Nous-Hermes-Llama2-70B-GGUF	medium	_logical_deduction_three_objects	Unknown	TheBloke	320	NousResearch/Nous-Hermes-Llama2-70b	44.67
Nous-Hermes-Llama2-70B-GGUF	medium	_tracking_shuffled_objects_three_objects	Unknown	TheBloke	321	NousResearch/Nous-Hermes-Llama2-70b	44.67
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_geometric_shapes	nous-hermes-2-solar-10-7b	TheBloke	322	NousResearch/Nous-Hermes-2-SOLAR-10.7B	44.57
Nous-Hermes-2-Yi-34B-GGUF	medium	_geometric_shapes	nous-hermes-2-yi-34b	TheBloke	323	NousResearch/Nous-Hermes-2-Yi-34B	44.57
Nous-Hermes-2-Yi-34B-AWQ	medium	_geometric_shapes	nous-hermes-2-yi-34b	TheBloke	324	NousResearch/Nous-Hermes-2-Yi-34B	44.57
Redmond-Puffin-13B-GGUF	medium	_ruin_names	Unknown	TheBloke	325	NousResearch/Redmond-Puffin-13B	44.42
Redmond-Puffin-13B-GPTQ	medium	_ruin_names	Unknown	TheBloke	326	NousResearch/Redmond-Puffin-13B	44.42
Nous-Hermes-Llama2-70B-GGUF	medium	_temporal_sequences	Unknown	TheBloke	327	NousResearch/Nous-Hermes-Llama2-70b	44.4
Beyonder-4x7B-v2-GGUF	medium	_movie_recommendation	beyonder-4x7b-v2	TheBloke	328	mlabonne/Beyonder-4x7B-v2	44.4
Beyonder-4x7B-v2	medium	_movie_recommendation	marcoro14-7b-slerp	mlabonne	329	mlabonne/Marcoro14-7B-slerp	44.4
DPOpenHermes-7B-v2-GGUF	medium	_ruin_names	dpopenhermes-7b-v2	TheBloke	330	openaccess-ai-collective/DPOpenHermes-7B-v2	43.75
DPOpenHermes-7B-GGUF	medium	_temporal_sequences	dpopenhermes-7b	TheBloke	331	openaccess-ai-collective/DPOpenHermes-7B	43.6
NeuralLlama-3-8B-Instruct-abliterated	low	Bigbench	Unknown	mlabonne	332	—	43.26
OpenHermes-2-Mistral-7B-GGUF	medium	_logical_deduction_three_objects	mistral-7b-v0-1	TheBloke	333	teknium/OpenHermes-2-Mistral-7B	43
OpenHermes-2-Mistral-7B-GGUF	medium	_tracking_shuffled_objects_three_objects	mistral-7b-v0-1	TheBloke	334	teknium/OpenHermes-2-Mistral-7B	43
OpenHermes-2-Mistral-7B-AWQ	medium	_logical_deduction_three_objects	mistral-7b-v0-1	TheBloke	335	teknium/OpenHermes-2-Mistral-7B	43
OpenHermes-2-Mistral-7B-AWQ	medium	_tracking_shuffled_objects_three_objects	mistral-7b-v0-1	TheBloke	336	teknium/OpenHermes-2-Mistral-7B	43
CapybaraHermes-2.5-Mistral-7B-GGUF	low	Bigbench	capybarahermes-2-5-mistral-7b	TheBloke	337	argilla/CapybaraHermes-2.5-Mistral-7B	42.44
CapybaraHermes-2.5-Mistral-7B-GPTQ	low	Bigbench	capybarahermes-2-5-mistral-7b	TheBloke	338	argilla/CapybaraHermes-2.5-Mistral-7B	42.44
CapybaraHermes-2.5-Mistral-7B-AWQ	low	Bigbench	capybarahermes-2-5-mistral-7b	TheBloke	339	argilla/CapybaraHermes-2.5-Mistral-7B	42.44
OpenHermes-2.5-Mistral-7B-AWQ	medium	_ruin_names	openhermes-2-5-mistral-7b	TheBloke	340	teknium/OpenHermes-2.5-Mistral-7B	42.41
OpenHermes-2.5-Mistral-7B-GGUF	medium	_ruin_names	openhermes-2-5-mistral-7b	TheBloke	341	teknium/OpenHermes-2.5-Mistral-7B	42.41
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_ruin_names	Unknown	TheBloke	342	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	42.41
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_ruin_names	openhermes-2-5-mistral-7b	TheBloke	343	teknium/OpenHermes-2.5-Mistral-7B	42.41
NeuralHermes-2.5-Mistral-7B-laser	low	Bigbench	openhermes-2-5-mistral-7b	mlabonne	344	teknium/OpenHermes-2.5-Mistral-7B	42.24
OpenHermes-2-Mistral-7B-GGUF	medium	_ruin_names	mistral-7b-v0-1	TheBloke	345	teknium/OpenHermes-2-Mistral-7B	42.19
OpenHermes-2-Mistral-7B-AWQ	medium	_ruin_names	mistral-7b-v0-1	TheBloke	346	teknium/OpenHermes-2-Mistral-7B	42.19
Redmond-Puffin-13B-GGUF	medium	_logical_deduction_three_objects	Unknown	TheBloke	347	NousResearch/Redmond-Puffin-13B	42
Redmond-Puffin-13B-GGUF	medium	_tracking_shuffled_objects_three_objects	Unknown	TheBloke	348	NousResearch/Redmond-Puffin-13B	42
Redmond-Puffin-13B-GPTQ	medium	_logical_deduction_three_objects	Unknown	TheBloke	349	NousResearch/Redmond-Puffin-13B	42
Redmond-Puffin-13B-GPTQ	medium	_tracking_shuffled_objects_three_objects	Unknown	TheBloke	350	NousResearch/Redmond-Puffin-13B	42
gemma-2-2b-it	medium	[BIG-Bench][big-bench]	gemma-2-2b	google	351	google/gemma-2-2b	41.9
gemma-2-2b	medium	[BIG-Bench][big-bench]	gemma-2-2b	google	352	google/gemma-2-2b	41.9
DPOpenHermes-7B-GGUF	medium	_ruin_names	dpopenhermes-7b	TheBloke	353	openaccess-ai-collective/DPOpenHermes-7B	41.74
Redmond-Hermes-Coder-GPTQ	medium	_reasoning_about_colored_objects	Unknown	TheBloke	354	—	41.5
DPOpenHermes-7B-GGUF	medium	_movie_recommendation	dpopenhermes-7b	TheBloke	355	openaccess-ai-collective/DPOpenHermes-7B	41.4
NeuralHermes-2.5-Mistral-7B-laser	medium	_movie_recommendation	openhermes-2-5-mistral-7b	mlabonne	356	teknium/OpenHermes-2.5-Mistral-7B	41.4
Tulpar-7B-v0-GGUF	medium	_logical_deduction_three_objects	Unknown	TheBloke	357	HyperbeeAI/Tulpar-7b-v0	41.33
Tulpar-7B-v0-GGUF	medium	_tracking_shuffled_objects_three_objects	Unknown	TheBloke	358	HyperbeeAI/Tulpar-7b-v0	41.33
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_disambiguation_qa	nous-hermes-2-solar-10-7b	TheBloke	359	NousResearch/Nous-Hermes-2-SOLAR-10.7B	39.53
Nous-Hermes-2-Yi-34B-GGUF	medium	_disambiguation_qa	nous-hermes-2-yi-34b	TheBloke	360	NousResearch/Nous-Hermes-2-Yi-34B	39.53
Nous-Hermes-2-Yi-34B-AWQ	medium	_disambiguation_qa	nous-hermes-2-yi-34b	TheBloke	361	NousResearch/Nous-Hermes-2-Yi-34B	39.53
Marcoro14-7B-slerp	medium	_movie_recommendation	marcoro14-7b-slerp	mlabonne	362	AIDC-ai-business/Marcoroni-7B-v3	39.2
DPOpenHermes-7B-v2-GGUF	medium	_movie_recommendation	dpopenhermes-7b-v2	TheBloke	363	openaccess-ai-collective/DPOpenHermes-7B-v2	38.8
OpenHermes-2-Mistral-7B-GGUF	medium	_disambiguation_qa	mistral-7b-v0-1	TheBloke	364	teknium/OpenHermes-2-Mistral-7B	38.76
OpenHermes-2-Mistral-7B-AWQ	medium	_disambiguation_qa	mistral-7b-v0-1	TheBloke	365	teknium/OpenHermes-2-Mistral-7B	38.76
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_temporal_sequences	nous-hermes-2-solar-10-7b	TheBloke	366	NousResearch/Nous-Hermes-2-SOLAR-10.7B	38.5
Nous-Hermes-2-Yi-34B-GGUF	medium	_temporal_sequences	nous-hermes-2-yi-34b	TheBloke	367	NousResearch/Nous-Hermes-2-Yi-34B	38.5
Nous-Hermes-2-Yi-34B-AWQ	medium	_temporal_sequences	nous-hermes-2-yi-34b	TheBloke	368	NousResearch/Nous-Hermes-2-Yi-34B	38.5
OpenHermes-2-Mistral-7B-GGUF	medium	_temporal_sequences	mistral-7b-v0-1	TheBloke	369	teknium/OpenHermes-2-Mistral-7B	38.3
OpenHermes-2-Mistral-7B-AWQ	medium	_temporal_sequences	mistral-7b-v0-1	TheBloke	370	teknium/OpenHermes-2-Mistral-7B	38.3
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_salient_translation_error_detection	nous-hermes-2-solar-10-7b	TheBloke	371	NousResearch/Nous-Hermes-2-SOLAR-10.7B	38.08
Nous-Hermes-2-Yi-34B-GGUF	medium	_salient_translation_error_detection	nous-hermes-2-yi-34b	TheBloke	372	NousResearch/Nous-Hermes-2-Yi-34B	38.08
Nous-Hermes-2-Yi-34B-AWQ	medium	_salient_translation_error_detection	nous-hermes-2-yi-34b	TheBloke	373	NousResearch/Nous-Hermes-2-Yi-34B	38.08
phixtral-2x2_8	low	Bigbench	dolphin-2-6-phi-2	mlabonne	374	cognitivecomputations/dolphin-2_6-phi-2	37.82
phixtral-4x2_8-GPTQ	low	Bigbench	Unknown	TheBloke	375	mlabonne/phixtral-4x2_8	37.68
phixtral-4x2_8	low	Bigbench	dolphin-2-6-phi-2	mlabonne	376	cognitivecomputations/dolphin-2_6-phi-2	37.68
OpenHermes-2-Mistral-7B-GGUF	medium	_geometric_shapes	mistral-7b-v0-1	TheBloke	377	teknium/OpenHermes-2-Mistral-7B	37.6
OpenHermes-2-Mistral-7B-AWQ	medium	_geometric_shapes	mistral-7b-v0-1	TheBloke	378	teknium/OpenHermes-2-Mistral-7B	37.6
Redmond-Hermes-Coder-GPTQ	medium	_logical_deduction_three_objects	Unknown	TheBloke	379	—	37.33
Redmond-Hermes-Coder-GPTQ	medium	_tracking_shuffled_objects_three_objects	Unknown	TheBloke	380	—	37.33
phi-2-orange-GGUF	low	Bigbench	phi-2-orange	TheBloke	381	rhysjones/phi-2-orange	37.3
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_movie_recommendation	nous-hermes-2-mixtral-8x7b-sft	TheBloke	382	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	37
Tulpar-7B-v0-GGUF	medium	_disambiguation_qa	Unknown	TheBloke	383	HyperbeeAI/Tulpar-7b-v0	36.43
OpenHermes-2.5-Mistral-7B-AWQ	medium	_movie_recommendation	openhermes-2-5-mistral-7b	TheBloke	384	teknium/OpenHermes-2.5-Mistral-7B	36.2
OpenHermes-2.5-Mistral-7B-GGUF	medium	_movie_recommendation	openhermes-2-5-mistral-7b	TheBloke	385	teknium/OpenHermes-2.5-Mistral-7B	36.2
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_movie_recommendation	Unknown	TheBloke	386	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	36.2
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_movie_recommendation	openhermes-2-5-mistral-7b	TheBloke	387	teknium/OpenHermes-2.5-Mistral-7B	36.2
DPOpenHermes-7B-GGUF	medium	_disambiguation_qa	dpopenhermes-7b	TheBloke	388	openaccess-ai-collective/DPOpenHermes-7B	35.66
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_movie_recommendation	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	389	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	35.4
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_movie_recommendation	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	390	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	35.4
stablelm-zephyr-3b-GGUF	medium	BigBench (Avg)	stablelm-zephyr-3b	TheBloke	391	stabilityai/stablelm-zephyr-3b	35.26
gemma-1.1-2b-it	medium	[BIG-Bench](https://arxiv.org/abs/2206.04615)	gemma-1-1-2b-it	google	392	google/gemma-1.1-2b-it	35.2
gemma-2b	medium	[BIG-Bench](https://arxiv.org/abs/2206.04615)	gemma-2b-it	google	393	google/gemma-2b-it-pytorch	35.2
gemma-2b-it	medium	[BIG-Bench](https://arxiv.org/abs/2206.04615)	gemma-2b-it	google	394	google/gemma-2b-it-pytorch	35.2
gemma-7b	medium	[BIG-Bench](https://arxiv.org/abs/2206.04615)	gemma-7b-it	google	395	google/gemma-7b-it-quant-pytorch	35.2
gemma-7b-it	medium	[BIG-Bench](https://arxiv.org/abs/2206.04615)	gemma-7b	google	396	google/gemma-7b	35.2
gemma-1.1-7b-it	medium	[BIG-Bench](https://arxiv.org/abs/2206.04615)	gemma-1-1-7b-it	google	397	google/gemma-1.1-7b-it	35.2
gemma-2b-AWQ	medium	[BIG-Bench](https://arxiv.org/abs/2206.04615)	gemma-2b-it	google	398	google/gemma-2b-it-pytorch	35.2
gemma-7b	medium	[BIG-Bench](https://arxiv.org/abs/2206.04615)	gemma-7b-it	alpindale	399	google/gemma-7b-it-quant-pytorch	35.2
gemma-2b	medium	[BIG-Bench](https://arxiv.org/abs/2206.04615)	gemma-2b-it	alpindale	400	google/gemma-2b-it-pytorch	35.2
gemma-7b-AWQ	medium	[BIG-Bench](https://arxiv.org/abs/2206.04615)	gemma-7b-it	google	401	google/gemma-7b-it-quant-pytorch	35.2
gemma-7b-it	medium	[BIG-Bench](https://arxiv.org/abs/2206.04615)	gemma-7b-it	alpindale	402	google/gemma-7b-it-quant-pytorch	35.2
gemma-7b-GGUF	medium	[BIG-Bench](https://arxiv.org/abs/2206.04615)	gemma-7b-it	google	403	google/gemma-7b-it-quant-pytorch	35.2
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_logical_deduction_five_objects	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	404	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	35
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_logical_deduction_five_objects	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	405	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	35
OpenHermes-2.5-Mistral-7B-AWQ	medium	_disambiguation_qa	openhermes-2-5-mistral-7b	TheBloke	406	teknium/OpenHermes-2.5-Mistral-7B	34.11
OpenHermes-2.5-Mistral-7B-GGUF	medium	_disambiguation_qa	openhermes-2-5-mistral-7b	TheBloke	407	teknium/OpenHermes-2.5-Mistral-7B	34.11
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_disambiguation_qa	Unknown	TheBloke	408	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	34.11
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_disambiguation_qa	openhermes-2-5-mistral-7b	TheBloke	409	teknium/OpenHermes-2.5-Mistral-7B	34.11
DPOpenHermes-7B-v2-GGUF	medium	_disambiguation_qa	dpopenhermes-7b-v2	TheBloke	410	openaccess-ai-collective/DPOpenHermes-7B-v2	34.11
NeuralHermes-2.5-Mistral-7B-laser	medium	_disambiguation_qa	openhermes-2-5-mistral-7b	mlabonne	411	teknium/OpenHermes-2.5-Mistral-7B	34.11
DPOpenHermes-7B-v2-GGUF	medium	_salient_translation_error_detection	dpopenhermes-7b-v2	TheBloke	412	openaccess-ai-collective/DPOpenHermes-7B-v2	33.37
Redmond-Hermes-Coder-GPTQ	medium	_disambiguation_qa	Unknown	TheBloke	413	—	32.95
Tulpar-7B-v0-GGUF	medium	_ruin_names	Unknown	TheBloke	414	HyperbeeAI/Tulpar-7b-v0	32.81
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_logical_deduction_five_objects	nous-hermes-2-mixtral-8x7b-sft	TheBloke	415	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	32.6
Redmond-Puffin-13B-GGUF	medium	_temporal_sequences	Unknown	TheBloke	416	NousResearch/Redmond-Puffin-13B	32.6
Redmond-Puffin-13B-GPTQ	medium	_temporal_sequences	Unknown	TheBloke	417	NousResearch/Redmond-Puffin-13B	32.6
Nous-Hermes-Llama2-70B-GGUF	medium	_movie_recommendation	Unknown	TheBloke	418	NousResearch/Nous-Hermes-Llama2-70b	32.4
Redmond-Hermes-Coder-GPTQ	medium	_movie_recommendation	Unknown	TheBloke	419	—	32
DPOpenHermes-7B-v2-GGUF	medium	_temporal_sequences	dpopenhermes-7b-v2	TheBloke	420	openaccess-ai-collective/DPOpenHermes-7B-v2	31.8
OpenHermes-2-Mistral-7B-GGUF	medium	_movie_recommendation	mistral-7b-v0-1	TheBloke	421	teknium/OpenHermes-2-Mistral-7B	31.4
OpenHermes-2-Mistral-7B-AWQ	medium	_movie_recommendation	mistral-7b-v0-1	TheBloke	422	teknium/OpenHermes-2-Mistral-7B	31.4
Gemmalpaca-2B	low	Bigbench	gemma-2b	mlabonne	423	google/gemma-2b	30.85
Beyonder-4x7B-v2-GGUF	medium	_logical_deduction_five_objects	beyonder-4x7b-v2	TheBloke	424	mlabonne/Beyonder-4x7B-v2	30.4
NeuralHermes-2.5-Mistral-7B-laser	medium	_temporal_sequences	openhermes-2-5-mistral-7b	mlabonne	425	teknium/OpenHermes-2.5-Mistral-7B	30.4
Beyonder-4x7B-v2	medium	_logical_deduction_five_objects	marcoro14-7b-slerp	mlabonne	426	mlabonne/Marcoro14-7B-slerp	30.4
Nous-Hermes-Llama2-70B-GGUF	medium	_disambiguation_qa	Unknown	TheBloke	427	NousResearch/Nous-Hermes-Llama2-70b	30.23
Redmond-Puffin-13B-GGUF	medium	_disambiguation_qa	Unknown	TheBloke	428	NousResearch/Redmond-Puffin-13B	30.23
Redmond-Puffin-13B-GPTQ	medium	_disambiguation_qa	Unknown	TheBloke	429	NousResearch/Redmond-Puffin-13B	30.23
Tulpar-7B-v0-GGUF	medium	_movie_recommendation	Unknown	TheBloke	430	HyperbeeAI/Tulpar-7b-v0	30
DPOpenHermes-7B-v2-GGUF	medium	_logical_deduction_five_objects	dpopenhermes-7b-v2	TheBloke	431	openaccess-ai-collective/DPOpenHermes-7B-v2	30
Marcoro14-7B-slerp	medium	_logical_deduction_five_objects	marcoro14-7b-slerp	mlabonne	432	AIDC-ai-business/Marcoroni-7B-v3	30
DPOpenHermes-7B-GGUF	medium	_logical_deduction_five_objects	dpopenhermes-7b	TheBloke	433	openaccess-ai-collective/DPOpenHermes-7B	29.8
Tulpar-7B-v0-GGUF	medium	_salient_translation_error_detection	Unknown	TheBloke	434	HyperbeeAI/Tulpar-7b-v0	29.76
Redmond-Hermes-Coder-GPTQ	medium	_salient_translation_error_detection	Unknown	TheBloke	435	—	29.26
Redmond-Puffin-13B-GGUF	medium	_movie_recommendation	Unknown	TheBloke	436	NousResearch/Redmond-Puffin-13B	29
Redmond-Puffin-13B-GPTQ	medium	_movie_recommendation	Unknown	TheBloke	437	NousResearch/Redmond-Puffin-13B	29
OpenHermes-2-Mistral-7B-GGUF	medium	_logical_deduction_five_objects	mistral-7b-v0-1	TheBloke	438	teknium/OpenHermes-2-Mistral-7B	28.8
OpenHermes-2-Mistral-7B-AWQ	medium	_logical_deduction_five_objects	mistral-7b-v0-1	TheBloke	439	teknium/OpenHermes-2-Mistral-7B	28.8
OpenHermes-2.5-Mistral-7B-AWQ	medium	_logical_deduction_five_objects	openhermes-2-5-mistral-7b	TheBloke	440	teknium/OpenHermes-2.5-Mistral-7B	28.6
OpenHermes-2.5-Mistral-7B-GGUF	medium	_logical_deduction_five_objects	openhermes-2-5-mistral-7b	TheBloke	441	teknium/OpenHermes-2.5-Mistral-7B	28.6
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_logical_deduction_five_objects	Unknown	TheBloke	442	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	28.6
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_logical_deduction_five_objects	openhermes-2-5-mistral-7b	TheBloke	443	teknium/OpenHermes-2.5-Mistral-7B	28.6
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_logical_deduction_five_objects	nous-hermes-2-solar-10-7b	TheBloke	444	NousResearch/Nous-Hermes-2-SOLAR-10.7B	28.2
Nous-Hermes-2-Yi-34B-GGUF	medium	_logical_deduction_five_objects	nous-hermes-2-yi-34b	TheBloke	445	NousResearch/Nous-Hermes-2-Yi-34B	28.2
Nous-Hermes-2-Yi-34B-AWQ	medium	_logical_deduction_five_objects	nous-hermes-2-yi-34b	TheBloke	446	NousResearch/Nous-Hermes-2-Yi-34B	28.2
OpenHermes-2.5-Mistral-7B-AWQ	medium	_temporal_sequences	openhermes-2-5-mistral-7b	TheBloke	447	teknium/OpenHermes-2.5-Mistral-7B	28
OpenHermes-2.5-Mistral-7B-GGUF	medium	_temporal_sequences	openhermes-2-5-mistral-7b	TheBloke	448	teknium/OpenHermes-2.5-Mistral-7B	28
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_temporal_sequences	Unknown	TheBloke	449	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	28
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_temporal_sequences	openhermes-2-5-mistral-7b	TheBloke	450	teknium/OpenHermes-2.5-Mistral-7B	28
NeuralHermes-2.5-Mistral-7B-laser	medium	_logical_deduction_five_objects	openhermes-2-5-mistral-7b	mlabonne	451	teknium/OpenHermes-2.5-Mistral-7B	27.8
Nous-Hermes-Llama2-70B-GGUF	medium	_logical_deduction_five_objects	Unknown	TheBloke	452	NousResearch/Nous-Hermes-Llama2-70b	27.6
NeuralHermes-2.5-Mistral-7B-laser	medium	_salient_translation_error_detection	openhermes-2-5-mistral-7b	mlabonne	453	teknium/OpenHermes-2.5-Mistral-7B	27.25
NeuralHermes-2.5-Mistral-7B-laser	medium	_geometric_shapes	openhermes-2-5-mistral-7b	mlabonne	454	teknium/OpenHermes-2.5-Mistral-7B	27.02
Tulpar-7B-v0-GGUF	medium	_logical_deduction_five_objects	Unknown	TheBloke	455	HyperbeeAI/Tulpar-7b-v0	27
Redmond-Hermes-Coder-GPTQ	medium	_temporal_sequences	Unknown	TheBloke	456	—	27
Nous-Hermes-Llama2-70B-GGUF	medium	_salient_translation_error_detection	Unknown	TheBloke	457	NousResearch/Nous-Hermes-Llama2-70b	25.85
Marcoro14-7B-slerp	medium	_salient_translation_error_detection	marcoro14-7b-slerp	mlabonne	458	AIDC-ai-business/Marcoroni-7B-v3	25.75
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_salient_translation_error_detection	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	459	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	25.35
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_salient_translation_error_detection	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	460	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	25.35
Redmond-Puffin-13B-GGUF	medium	_logical_deduction_five_objects	Unknown	TheBloke	461	NousResearch/Redmond-Puffin-13B	25.2
Redmond-Puffin-13B-GPTQ	medium	_logical_deduction_five_objects	Unknown	TheBloke	462	NousResearch/Redmond-Puffin-13B	25.2
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_salient_translation_error_detection	nous-hermes-2-mixtral-8x7b-sft	TheBloke	463	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	25.05
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_logical_deduction_seven_objects	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	464	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	25
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_logical_deduction_seven_objects	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	465	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	25
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_logical_deduction_seven_objects	nous-hermes-2-mixtral-8x7b-sft	TheBloke	466	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	24.43
Beyonder-4x7B-v2-GGUF	medium	_salient_translation_error_detection	beyonder-4x7b-v2	TheBloke	467	mlabonne/Beyonder-4x7B-v2	23.65
Beyonder-4x7B-v2	medium	_salient_translation_error_detection	marcoro14-7b-slerp	mlabonne	468	mlabonne/Marcoro14-7B-slerp	23.65
Marcoro14-7B-slerp	medium	_tracking_shuffled_objects_five_objects	marcoro14-7b-slerp	mlabonne	469	AIDC-ai-business/Marcoroni-7B-v3	23.44
Nous-Hermes-Llama2-70B-GGUF	medium	_geometric_shapes	Unknown	TheBloke	470	NousResearch/Nous-Hermes-Llama2-70b	23.4
OpenHermes-2.5-Mistral-7B-AWQ	medium	_salient_translation_error_detection	openhermes-2-5-mistral-7b	TheBloke	471	teknium/OpenHermes-2.5-Mistral-7B	22.85
OpenHermes-2.5-Mistral-7B-GGUF	medium	_salient_translation_error_detection	openhermes-2-5-mistral-7b	TheBloke	472	teknium/OpenHermes-2.5-Mistral-7B	22.85
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_salient_translation_error_detection	Unknown	TheBloke	473	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	22.85
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_salient_translation_error_detection	openhermes-2-5-mistral-7b	TheBloke	474	teknium/OpenHermes-2.5-Mistral-7B	22.85
Redmond-Hermes-Coder-GPTQ	medium	_logical_deduction_five_objects	Unknown	TheBloke	475	—	22.6
Beyonder-4x7B-v2-GGUF	medium	_geometric_shapes	beyonder-4x7b-v2	TheBloke	476	mlabonne/Beyonder-4x7B-v2	22.56
NeuralHermes-2.5-Mistral-7B-laser	medium	_tracking_shuffled_objects_five_objects	openhermes-2-5-mistral-7b	mlabonne	477	teknium/OpenHermes-2.5-Mistral-7B	22.56
Beyonder-4x7B-v2	medium	_geometric_shapes	marcoro14-7b-slerp	mlabonne	478	mlabonne/Marcoro14-7B-slerp	22.56
Beyonder-4x7B-v2-GGUF	medium	_tracking_shuffled_objects_five_objects	beyonder-4x7b-v2	TheBloke	479	mlabonne/Beyonder-4x7B-v2	22.08
Beyonder-4x7B-v2	medium	_tracking_shuffled_objects_five_objects	marcoro14-7b-slerp	mlabonne	480	mlabonne/Marcoro14-7B-slerp	22.08
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_tracking_shuffled_objects_five_objects	nous-hermes-2-mixtral-8x7b-sft	TheBloke	481	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	22
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_logical_deduction_seven_objects	nous-hermes-2-solar-10-7b	TheBloke	482	NousResearch/Nous-Hermes-2-SOLAR-10.7B	21.86
Nous-Hermes-2-Yi-34B-GGUF	medium	_logical_deduction_seven_objects	nous-hermes-2-yi-34b	TheBloke	483	NousResearch/Nous-Hermes-2-Yi-34B	21.86
Nous-Hermes-2-Yi-34B-AWQ	medium	_logical_deduction_seven_objects	nous-hermes-2-yi-34b	TheBloke	484	NousResearch/Nous-Hermes-2-Yi-34B	21.86
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_tracking_shuffled_objects_five_objects	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	485	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	21.76
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_tracking_shuffled_objects_five_objects	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	486	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	21.76
OpenHermes-2-Mistral-7B-GGUF	medium	_tracking_shuffled_objects_five_objects	mistral-7b-v0-1	TheBloke	487	teknium/OpenHermes-2-Mistral-7B	21.68
Nous-Hermes-Llama2-70B-GGUF	medium	_tracking_shuffled_objects_five_objects	Unknown	TheBloke	488	NousResearch/Nous-Hermes-Llama2-70b	21.68
OpenHermes-2-Mistral-7B-AWQ	medium	_tracking_shuffled_objects_five_objects	mistral-7b-v0-1	TheBloke	489	teknium/OpenHermes-2-Mistral-7B	21.68
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_tracking_shuffled_objects_five_objects	nous-hermes-2-solar-10-7b	TheBloke	490	NousResearch/Nous-Hermes-2-SOLAR-10.7B	21.6
Nous-Hermes-2-Yi-34B-GGUF	medium	_tracking_shuffled_objects_five_objects	nous-hermes-2-yi-34b	TheBloke	491	NousResearch/Nous-Hermes-2-Yi-34B	21.6
Nous-Hermes-2-Yi-34B-AWQ	medium	_tracking_shuffled_objects_five_objects	nous-hermes-2-yi-34b	TheBloke	492	NousResearch/Nous-Hermes-2-Yi-34B	21.6
OpenHermes-2.5-Mistral-7B-AWQ	medium	_geometric_shapes	openhermes-2-5-mistral-7b	TheBloke	493	teknium/OpenHermes-2.5-Mistral-7B	21.45
OpenHermes-2.5-Mistral-7B-GGUF	medium	_geometric_shapes	openhermes-2-5-mistral-7b	TheBloke	494	teknium/OpenHermes-2.5-Mistral-7B	21.45
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_geometric_shapes	Unknown	TheBloke	495	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	21.45
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_geometric_shapes	openhermes-2-5-mistral-7b	TheBloke	496	teknium/OpenHermes-2.5-Mistral-7B	21.45
Marcoro14-7B-slerp	medium	_logical_deduction_seven_objects	marcoro14-7b-slerp	mlabonne	497	AIDC-ai-business/Marcoroni-7B-v3	21.43
Redmond-Hermes-Coder-GPTQ	medium	_ruin_names	Unknown	TheBloke	498	—	21.43
Redmond-Puffin-13B-GGUF	medium	_tracking_shuffled_objects_five_objects	Unknown	TheBloke	499	NousResearch/Redmond-Puffin-13B	21.36
Redmond-Puffin-13B-GPTQ	medium	_tracking_shuffled_objects_five_objects	Unknown	TheBloke	500	NousResearch/Redmond-Puffin-13B	21.36
DPOpenHermes-7B-v2-GGUF	medium	_tracking_shuffled_objects_five_objects	dpopenhermes-7b-v2	TheBloke	501	openaccess-ai-collective/DPOpenHermes-7B-v2	21.2
DPOpenHermes-7B-GGUF	medium	_tracking_shuffled_objects_five_objects	dpopenhermes-7b	TheBloke	502	openaccess-ai-collective/DPOpenHermes-7B	21.12
DPOpenHermes-7B-v2-GGUF	medium	_geometric_shapes	dpopenhermes-7b-v2	TheBloke	503	openaccess-ai-collective/DPOpenHermes-7B-v2	20.89
OpenHermes-2.5-Mistral-7B-AWQ	medium	_logical_deduction_seven_objects	openhermes-2-5-mistral-7b	TheBloke	504	teknium/OpenHermes-2.5-Mistral-7B	20.86
OpenHermes-2.5-Mistral-7B-GGUF	medium	_logical_deduction_seven_objects	openhermes-2-5-mistral-7b	TheBloke	505	teknium/OpenHermes-2.5-Mistral-7B	20.86
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_logical_deduction_seven_objects	Unknown	TheBloke	506	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	20.86
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_logical_deduction_seven_objects	openhermes-2-5-mistral-7b	TheBloke	507	teknium/OpenHermes-2.5-Mistral-7B	20.86
Redmond-Puffin-13B-GGUF	medium	_salient_translation_error_detection	Unknown	TheBloke	508	NousResearch/Redmond-Puffin-13B	20.74
Redmond-Puffin-13B-GPTQ	medium	_salient_translation_error_detection	Unknown	TheBloke	509	NousResearch/Redmond-Puffin-13B	20.74
OpenHermes-2.5-Mistral-7B-AWQ	medium	_tracking_shuffled_objects_five_objects	openhermes-2-5-mistral-7b	TheBloke	510	teknium/OpenHermes-2.5-Mistral-7B	20.72
OpenHermes-2.5-Mistral-7B-GGUF	medium	_tracking_shuffled_objects_five_objects	openhermes-2-5-mistral-7b	TheBloke	511	teknium/OpenHermes-2.5-Mistral-7B	20.72
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_tracking_shuffled_objects_five_objects	Unknown	TheBloke	512	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	20.72
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_tracking_shuffled_objects_five_objects	openhermes-2-5-mistral-7b	TheBloke	513	teknium/OpenHermes-2.5-Mistral-7B	20.72
DPOpenHermes-7B-GGUF	medium	_logical_deduction_seven_objects	dpopenhermes-7b	TheBloke	514	openaccess-ai-collective/DPOpenHermes-7B	20.71
OpenHermes-2-Mistral-7B-GGUF	medium	_logical_deduction_seven_objects	mistral-7b-v0-1	TheBloke	515	teknium/OpenHermes-2-Mistral-7B	20.57
DPOpenHermes-7B-v2-GGUF	medium	_logical_deduction_seven_objects	dpopenhermes-7b-v2	TheBloke	516	openaccess-ai-collective/DPOpenHermes-7B-v2	20.57
Beyonder-4x7B-v2-GGUF	medium	_logical_deduction_seven_objects	beyonder-4x7b-v2	TheBloke	517	mlabonne/Beyonder-4x7B-v2	20.57
Beyonder-4x7B-v2	medium	_logical_deduction_seven_objects	marcoro14-7b-slerp	mlabonne	518	mlabonne/Marcoro14-7B-slerp	20.57
OpenHermes-2-Mistral-7B-AWQ	medium	_logical_deduction_seven_objects	mistral-7b-v0-1	TheBloke	519	teknium/OpenHermes-2-Mistral-7B	20.57
DPOpenHermes-7B-GGUF	medium	_salient_translation_error_detection	dpopenhermes-7b	TheBloke	520	openaccess-ai-collective/DPOpenHermes-7B	20.44
Marcoro14-7B-slerp	medium	_geometric_shapes	marcoro14-7b-slerp	mlabonne	521	AIDC-ai-business/Marcoroni-7B-v3	20.33
DPOpenHermes-7B-GGUF	medium	_geometric_shapes	dpopenhermes-7b	TheBloke	522	openaccess-ai-collective/DPOpenHermes-7B	20.06
Tulpar-7B-v0-GGUF	medium	_dyck_languages	Unknown	TheBloke	523	HyperbeeAI/Tulpar-7b-v0	20
NeuralHermes-2.5-Mistral-7B-laser	medium	_logical_deduction_seven_objects	openhermes-2-5-mistral-7b	mlabonne	524	teknium/OpenHermes-2.5-Mistral-7B	19.86
Tulpar-7B-v0-GGUF	medium	_tracking_shuffled_objects_five_objects	Unknown	TheBloke	525	HyperbeeAI/Tulpar-7b-v0	19.76
Redmond-Hermes-Coder-GPTQ	medium	_logical_deduction_seven_objects	Unknown	TheBloke	526	—	19.57
Tulpar-7B-v0-GGUF	medium	_logical_deduction_seven_objects	Unknown	TheBloke	527	HyperbeeAI/Tulpar-7b-v0	19.29
Beyonder-4x7B-v2-GGUF	medium	_tracking_shuffled_objects_seven_objects	beyonder-4x7b-v2	TheBloke	528	mlabonne/Beyonder-4x7B-v2	19.03
Beyonder-4x7B-v2	medium	_tracking_shuffled_objects_seven_objects	marcoro14-7b-slerp	mlabonne	529	mlabonne/Marcoro14-7B-slerp	19.03
Nous-Hermes-Llama2-70B-GGUF	medium	_logical_deduction_seven_objects	Unknown	TheBloke	530	NousResearch/Nous-Hermes-Llama2-70b	18.71
Redmond-Hermes-Coder-GPTQ	medium	_tracking_shuffled_objects_five_objects	Unknown	TheBloke	531	—	18.64
Marcoro14-7B-slerp	medium	_tracking_shuffled_objects_seven_objects	marcoro14-7b-slerp	mlabonne	532	AIDC-ai-business/Marcoroni-7B-v3	18.51
DPOpenHermes-7B-GGUF	medium	_tracking_shuffled_objects_seven_objects	dpopenhermes-7b	TheBloke	533	openaccess-ai-collective/DPOpenHermes-7B	17.54
Redmond-Puffin-13B-GGUF	medium	_logical_deduction_seven_objects	Unknown	TheBloke	534	NousResearch/Redmond-Puffin-13B	17.43
Redmond-Puffin-13B-GPTQ	medium	_logical_deduction_seven_objects	Unknown	TheBloke	535	NousResearch/Redmond-Puffin-13B	17.43
DPOpenHermes-7B-v2-GGUF	medium	_tracking_shuffled_objects_seven_objects	dpopenhermes-7b-v2	TheBloke	536	openaccess-ai-collective/DPOpenHermes-7B-v2	17.2
NeuralHermes-2.5-Mistral-7B-laser	medium	_tracking_shuffled_objects_seven_objects	openhermes-2-5-mistral-7b	mlabonne	537	teknium/OpenHermes-2.5-Mistral-7B	17.09
OpenHermes-2-Mistral-7B-GGUF	medium	_salient_translation_error_detection	mistral-7b-v0-1	TheBloke	538	teknium/OpenHermes-2-Mistral-7B	16.93
OpenHermes-2-Mistral-7B-AWQ	medium	_salient_translation_error_detection	mistral-7b-v0-1	TheBloke	539	teknium/OpenHermes-2-Mistral-7B	16.93
OpenHermes-2.5-Mistral-7B-AWQ	medium	_tracking_shuffled_objects_seven_objects	openhermes-2-5-mistral-7b	TheBloke	540	teknium/OpenHermes-2.5-Mistral-7B	16.91
OpenHermes-2.5-Mistral-7B-GGUF	medium	_tracking_shuffled_objects_seven_objects	openhermes-2-5-mistral-7b	TheBloke	541	teknium/OpenHermes-2.5-Mistral-7B	16.91
OpenHermes-2.5-Mistral-7B-16k-GGUF	medium	_tracking_shuffled_objects_seven_objects	Unknown	TheBloke	542	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	16.91
OpenHermes-2.5-Mistral-7B-GPTQ	medium	_tracking_shuffled_objects_seven_objects	openhermes-2-5-mistral-7b	TheBloke	543	teknium/OpenHermes-2.5-Mistral-7B	16.91
Nous-Hermes-2-SOLAR-10.7B-GGUF	medium	_tracking_shuffled_objects_seven_objects	nous-hermes-2-solar-10-7b	TheBloke	544	NousResearch/Nous-Hermes-2-SOLAR-10.7B	16.34
Nous-Hermes-2-Yi-34B-GGUF	medium	_tracking_shuffled_objects_seven_objects	nous-hermes-2-yi-34b	TheBloke	545	NousResearch/Nous-Hermes-2-Yi-34B	16.34
Nous-Hermes-2-Yi-34B-AWQ	medium	_tracking_shuffled_objects_seven_objects	nous-hermes-2-yi-34b	TheBloke	546	NousResearch/Nous-Hermes-2-Yi-34B	16.34
OpenHermes-2-Mistral-7B-GGUF	medium	_tracking_shuffled_objects_seven_objects	mistral-7b-v0-1	TheBloke	547	teknium/OpenHermes-2-Mistral-7B	15.49
OpenHermes-2-Mistral-7B-AWQ	medium	_tracking_shuffled_objects_seven_objects	mistral-7b-v0-1	TheBloke	548	teknium/OpenHermes-2-Mistral-7B	15.49
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	medium	_tracking_shuffled_objects_seven_objects	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	549	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	15.43
Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	medium	_tracking_shuffled_objects_seven_objects	nous-hermes-2-mixtral-8x7b-dpo	TheBloke	550	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	15.43
Nous-Hermes-Llama2-70B-GGUF	medium	_tracking_shuffled_objects_seven_objects	Unknown	TheBloke	551	NousResearch/Nous-Hermes-Llama2-70b	15.31
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	medium	_tracking_shuffled_objects_seven_objects	nous-hermes-2-mixtral-8x7b-sft	TheBloke	552	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	15.03
Tulpar-7B-v0-GGUF	medium	_temporal_sequences	Unknown	TheBloke	553	HyperbeeAI/Tulpar-7b-v0	14.5
Tulpar-7B-v0-GGUF	medium	_tracking_shuffled_objects_seven_objects	Unknown	TheBloke	554	HyperbeeAI/Tulpar-7b-v0	14.4
Redmond-Hermes-Coder-GPTQ	medium	_tracking_shuffled_objects_seven_objects	Unknown	TheBloke	555	—	13.49
Redmond-Puffin-13B-GGUF	medium	_tracking_shuffled_objects_seven_objects	Unknown	TheBloke	556	NousResearch/Redmond-Puffin-13B	13.26
Redmond-Puffin-13B-GPTQ	medium	_tracking_shuffled_objects_seven_objects	Unknown	TheBloke	557	NousResearch/Redmond-Puffin-13B	13.26
Redmond-Puffin-13B-GGUF	medium	_geometric_shapes	Unknown	TheBloke	558	NousResearch/Redmond-Puffin-13B	10.03
Redmond-Puffin-13B-GPTQ	medium	_geometric_shapes	Unknown	TheBloke	559	NousResearch/Redmond-Puffin-13B	10.03
Redmond-Hermes-Coder-GPTQ	medium	_geometric_shapes	Unknown	TheBloke	560	—	10.03
gemma-3-270m	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m	google	561	google/gemma-3-270m	7.2
gemma-3-270m-it	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m	google	562	google/gemma-3-270m	7.2
gemma-3-270m-it-GGUF	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m-it	unsloth	563	google/gemma-3-270m-it	7.2
gemma-3-270m-it	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m-it	unsloth	564	google/gemma-3-270m-it	7.2
gemma-3-270m-it-unsloth-bnb-4bit	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m-it	unsloth	565	google/gemma-3-270m-it	7.2
gemma-3-270m-it-qat-GGUF	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	566	google/gemma-3-270m-it-qat-q4_0-unquantized	7.2
gemma-3-270m	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m	unsloth	567	google/gemma-3-270m	7.2
gemma-3-270m-unsloth-bnb-4bit	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m-it	unsloth	568	google/gemma-3-270m-it	7.2
gemma-3-270m-it-qat-q4_0-unquantized	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m-it	google	569	google/gemma-3-270m-it	7.2
gemma-3-270m-it-bnb-4bit	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m-it	unsloth	570	google/gemma-3-270m-it	7.2
gemma-3-270m-it-qat	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m-it-qat-q4-0-unquantized	unsloth	571	google/gemma-3-270m-it-qat-q4_0-unquantized	7.2
gemma-3-270m-bnb-4bit	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m	unsloth	572	google/gemma-3-270m	7.2
gemma-3-270m-qat-q4_0-unquantized	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m	google	573	google/gemma-3-270m	7.2
gemma-3-270m-it-GGUF	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m	Mungert	574	google/gemma-3-270m	7.2
gemma-3-270m-it-torchao-FP8	medium	[BIG-Bench Extra Hard][bbeh]	gemma-3-270m-it	unsloth	575	google/gemma-3-270m-it	7.2

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/bigbench.html, docs/notes/hf-benchmark-contexts.json
url: huggingface.co/spaces/bigbench ↗