Local AI Registry

Leaderboard

MUSR

musr
JSON APIBack to leaderboard search

Record

Category
reasoning
Scored models
29

Scores

ModelScore
tencent/Youtu-LLM-2B-Base43.8
meta-llama/Llama-3.1-70B24.49
NousResearch/Hermes-3-Llama-3.1-70B22.02
—14.54
tiiuae/Falcon3-10B-Base14.17
tiiuae/Falcon3-10B-Base13.61
tiiuae/falcon-mamba-7b10.86
tiiuae/falcon-mamba-7b10.86
tiiuae/falcon-mamba-7b10.86
tiiuae/falcon-mamba-7b-instruct10.86
tiiuae/falcon-mamba-7b-instruct10.86
tiiuae/falcon-mamba-7b10.86
tiiuae/falcon-mamba-7b10.86
tiiuae/falcon-mamba-7b10.86
tiiuae/falcon-mamba-7b10.86
tiiuae/falcon-mamba-7b10.86
allenai/Llama-3.1-Tulu-3-8B-DPO10.52
NousResearch/Meta-Llama-3-8B-Instruct8.38
ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.15.56
ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.15.31
NousResearch/Meta-Llama-3-8B-Instruct5.25
tiiuae/Falcon-E-3B-Base4.14
tiiuae/Falcon-E-3B-Base-prequantized4.14
tiiuae/Falcon-E-1B-Base3.65

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category
reasoning
id
musr
name
MUSR
schema version
local-ai-registry/v1

rows

variantconfcontextmodel idorgrankrootscore
Youtu-LLM-2B-GGUFmediumMUSRyoutu-llm-2b-baseMungert1tencent/Youtu-LLM-2B-Base43.8
Llama-3.1-Tulu-3-70B-SFTmediumMuSR (0-shot)llama-3-1-70ballenai2meta-llama/Llama-3.1-70B24.49
Hermes-3-Llama-3.1-70B-lorablatedmediumMuSR (0-shot)hermes-3-llama-3-1-70bmlabonne3NousResearch/Hermes-3-Llama-3.1-70B22.02
WizardLM-2-8x22BmediumMuSR (0-shot)Unknownalpindale4—14.54
Falcon3-10B-BasemediumMuSR (0-shot)falcon3-10b-basetiiuae5tiiuae/Falcon3-10B-Base14.17
Falcon3-10B-InstructmediumMuSR (0-shot)falcon3-10b-basetiiuae6tiiuae/Falcon3-10B-Base13.61
falcon-mamba-7blowUnknownfalcon-mamba-7btiiuae7tiiuae/falcon-mamba-7b10.86
falcon-mamba-7bmediumMuSR (0-shot)falcon-mamba-7btiiuae8tiiuae/falcon-mamba-7b10.86
falcon-mamba-7b-instructlowUnknownfalcon-mamba-7btiiuae9tiiuae/falcon-mamba-7b10.86
falcon-mamba-7b-instruct-Q4_K_M-GGUFlowUnknownfalcon-mamba-7b-instructtiiuae10tiiuae/falcon-mamba-7b-instruct10.86
falcon-mamba-7b-instruct-4bitlowUnknownfalcon-mamba-7b-instructtiiuae11tiiuae/falcon-mamba-7b-instruct10.86
falcon-mamba-7b-Q8_0-GGUFlowUnknownfalcon-mamba-7btiiuae12tiiuae/falcon-mamba-7b10.86
falcon-mamba-7b-Q8_0-GGUFmediumMuSR (0-shot)falcon-mamba-7btiiuae13tiiuae/falcon-mamba-7b10.86
falcon-mamba-7b-F16-GGUFlowUnknownfalcon-mamba-7btiiuae14tiiuae/falcon-mamba-7b10.86
falcon-mamba-7b-F16-GGUFmediumMuSR (0-shot)falcon-mamba-7btiiuae15tiiuae/falcon-mamba-7b10.86
falcon-mamba-7b-4bitlowUnknownfalcon-mamba-7btiiuae16tiiuae/falcon-mamba-7b10.86
Llama-3.1-Tulu-3-8BmediumMuSR (0-shot)llama-3-1-tulu-3-8b-dpoallenai17allenai/Llama-3.1-Tulu-3-8B-DPO10.52
ChimeraLlama-3-8B-v3mediumMuSR (0-shot)meta-llama-3-8b-instructmlabonne18NousResearch/Meta-Llama-3-8B-Instruct8.38
Mistral-Nemo-12B-ArliAI-RPMax-v1.1mediumMuSR (0-shot)mistral-nemo-12b-arliai-rpmax-v1-1ArliAI19ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.15.56
Llama-3.1-8B-ArliAI-RPMax-v1.1mediumMuSR (0-shot)llama-3-1-8b-arliai-rpmax-v1-1ArliAI20ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.15.31
ChimeraLlama-3-8B-v2mediumMuSR (0-shot)meta-llama-3-8b-instructmlabonne21NousResearch/Meta-Llama-3-8B-Instruct5.25
Falcon-E-3B-BasehighUnknownfalcon-e-3b-basetiiuae22tiiuae/Falcon-E-3B-Base4.14
Falcon-E-3B-Base-prequantizedhighUnknownfalcon-e-3b-base-prequantizedtiiuae23tiiuae/Falcon-E-3B-Base-prequantized4.14
Falcon-E-1B-BasehighUnknownfalcon-e-1b-basetiiuae24tiiuae/Falcon-E-1B-Base3.65
Meta-Llama-3.1-8B-Instruct-abliteratedmediumMuSR (0-shot)meta-llama-3-1-8b-instructmlabonne25meta-llama/Meta-Llama-3.1-8B-Instruct3.21
Falcon-E-1B-Instruct-GGUFhighUnknownfalcon-e-1b-basetiiuae26tiiuae/Falcon-E-1B-Base2.51
Falcon-E-1B-InstructhighUnknownfalcon-e-1b-instructtiiuae27tiiuae/Falcon-E-1B-Instruct2.51
Falcon-E-3B-InstructhighUnknownfalcon-e-3b-instructtiiuae28tiiuae/Falcon-E-3B-Instruct2.12
Falcon-E-3B-Instruct-GGUFhighUnknownfalcon-e-3b-basetiiuae29tiiuae/Falcon-E-3B-Base2.12
Provenance & metadata (1)

source

kind
leaderboard-scrape
paths
benchmarks/musr.html