Local AI Registry

Leaderboard

MMBench

mmbench
JSON APIBack to leaderboard search

Record

Category
multimodal
Scored models
85

Scores

ModelScore
Qwen/Qwen2.5-VL-72B-Instruct88.2
Qwen/Qwen2.5-VL-7B-Instruct87.9
Qwen/Qwen2.5-VL-3B-Instruct87.9
Qwen/Qwen2.5-VL-32B-Instruct87.3
Qwen/Qwen2-VL-72B-Instruct86.94
Qwen/Qwen2-VL-72B-Instruct86.94
Qwen/Qwen2-VL-72B-Instruct86.94
microsoft/Phi-4-multimodal-instruct86.7
microsoft/Phi-4-multimodal-instruct86.7
microsoft/Mage-VL84.02
zai-org/glm-4v-9b83.4
moonshotai/Moonlight-16B-A3B83.1
Qwen/Qwen2.5-7B-Instruct83.1
moonshotai/Kimi-VL-A3B-Instruct83.1
Qwen/Qwen2.5-VL-72B-Instruct82.1
Qwen/Qwen2.5-VL-72B-Instruct82.1
Qwen/Qwen2.5-VL-72B-Instruct82.1
Qwen/Qwen2.5-VL-72B-Instruct82.1
Qwen/Qwen2.5-VL-72B-Instruct82.1
microsoft/Mage-VL82.04
Qwen/Qwen2.5-Omni-3B81.8
Qwen/Qwen2.5-Omni-7B81.8
Qwen/Qwen2.5-Omni-7B81.8
Qwen/Qwen2.5-Omni-3B81.8

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category
multimodal
id
mmbench
name
MMBench
schema version
local-ai-registry/v1

rows

variantconfcontextmodel idorgrankrootscore
Qwen2.5-VL-72B-Instruct-AWQhighUnknownqwen2-5-vl-72b-instructQwen1Qwen/Qwen2.5-VL-72B-Instruct88.2
Qwen2.5-VL-7B-Instruct-AWQhighUnknownqwen2-5-vl-7b-instructQwen2Qwen/Qwen2.5-VL-7B-Instruct87.9
Qwen2.5-VL-3B-Instruct-AWQhighUnknownqwen2-5-vl-3b-instructQwen3Qwen/Qwen2.5-VL-3B-Instruct87.9
Qwen2.5-VL-32B-Instruct-AWQhighUnknownqwen2-5-vl-32b-instructQwen4Qwen/Qwen2.5-VL-32B-Instruct87.3
Qwen2-VL-72B-Instruct-AWQhighUnknownqwen2-vl-72b-instructQwen5Qwen/Qwen2-VL-72B-Instruct86.94
Qwen2-VL-72B-Instruct-GPTQ-Int4highUnknownqwen2-vl-72b-instructQwen6Qwen/Qwen2-VL-72B-Instruct86.94
Qwen2-VL-72B-Instruct-GPTQ-Int8highUnknownqwen2-vl-72b-instructQwen7Qwen/Qwen2-VL-72B-Instruct86.94
Phi-4-multimodal-instructmediumMMBench (dev-en)phi-4-multimodal-instructmicrosoft8microsoft/Phi-4-multimodal-instruct86.7
Phi-4-multimodal-instructmediumMMBench (dev-en)phi-4-multimodal-instructLexius9microsoft/Phi-4-multimodal-instruct86.7
Mage-VLmediumMMBench-EN-devmage-vlmicrosoft10microsoft/Mage-VL84.02
glm-4v-9blowUnknownUnknownzai-org11zai-org/glm-4v-9b83.4
Kimi-VL-A3B-InstructmediumMMBench-EN-v1.1 (Acc)Unknownmoonshotai12moonshotai/Moonlight-16B-A3B83.1
Eagle2.5-8BmediumMMBench_V11<sub>test</sub>qwen2-5-7b-instructnvidia13Qwen/Qwen2.5-7B-Instruct83.1
Kimi-VL-A3B-Thinking-2506mediumMMBench-EN-v1.1 (Acc)kimi-vl-a3b-instructmoonshotai14moonshotai/Kimi-VL-A3B-Instruct83.1
Qwen2.5-VL-72B-InstructmediumMMBench_DEV_EN_V11qwen2-5-vl-72b-instructQwen15Qwen/Qwen2.5-VL-72B-Instruct82.1
Qwen2.5-VL-72B-Instruct-GGUFmediumMMBench_DEV_EN_V11qwen2-5-vl-72b-instructunsloth16Qwen/Qwen2.5-VL-72B-Instruct82.1
Qwen2.5-VL-72B-Instruct-GGUFmediumMMBench_DEV_EN_V11qwen2-5-vl-72b-instructMungert17Qwen/Qwen2.5-VL-72B-Instruct82.1
Qwen2.5-VL-72B-Instruct-bnb-4bitmediumMMBench_DEV_EN_V11qwen2-5-vl-72b-instructunsloth18Qwen/Qwen2.5-VL-72B-Instruct82.1
Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bitmediumMMBench_DEV_EN_V11qwen2-5-vl-72b-instructunsloth19Qwen/Qwen2.5-VL-72B-Instruct82.1
Mage-VLmediumMMBench-CN-devmage-vlmicrosoft20microsoft/Mage-VL82.04
Qwen2.5-Omni-3BmediumMMBench-V1.1-EN<sub>test</sub>qwen2-5-omni-3bQwen21Qwen/Qwen2.5-Omni-3B81.8
Qwen2.5-Omni-7BmediumMMBench-V1.1-EN<sub>test</sub>qwen2-5-omni-7bQwen22Qwen/Qwen2.5-Omni-7B81.8
Qwen2.5-Omni-7B-GGUFmediumMMBench-V1.1-EN<sub>test</sub>qwen2-5-omni-7bunsloth23Qwen/Qwen2.5-Omni-7B81.8
Qwen2.5-Omni-3B-GGUFmediumMMBench-V1.1-EN<sub>test</sub>qwen2-5-omni-3bunsloth24Qwen/Qwen2.5-Omni-3B81.8
Qwen2.5-Omni-3B-GGUFmediumMMBench-V1.1-EN<sub>test</sub>qwen2-5-omni-3bMungert25Qwen/Qwen2.5-Omni-3B81.8
Qwen2.5-Omni-7BmediumMMBench-V1.1-EN<sub>test</sub>qwen2-5-omni-7bunsloth26Qwen/Qwen2.5-Omni-7B81.8
Qwen2.5-Omni-7B-GGUFmediumMMBench-V1.1-EN<sub>test</sub>qwen2-5-omni-7bMungert27Qwen/Qwen2.5-Omni-7B81.8
Qwen2.5-Omni-3BmediumMMBench-V1.1-EN<sub>test</sub>qwen2-5-omni-3bunsloth28Qwen/Qwen2.5-Omni-3B81.8
Qwen2-VL-7B-Instruct-AWQhighUnknownqwen2-vl-7b-instructQwen29Qwen/Qwen2-VL-7B-Instruct81.78
Qwen2-VL-7B-Instruct-GPTQ-Int8highUnknownqwen2-vl-7b-instructQwen30Qwen/Qwen2-VL-7B-Instruct81.78
Qwen2-VL-7B-Instruct-GPTQ-Int4highUnknownqwen2-vl-7b-instructQwen31Qwen/Qwen2-VL-7B-Instruct81.78
Qwen2-VL-7B-InstructmediumMMBench-EN<sub>test</sub>qwen2-vl-7bQwen32Qwen/Qwen2-VL-7B81.7
Qwen2-VL-7B-Instruct-unsloth-bnb-4bitmediumMMBench-EN<sub>test</sub>qwen2-vl-7b-instructunsloth33Qwen/Qwen2-VL-7B-Instruct81.7
Qwen2-VL-7B-Instruct-bnb-4bitmediumMMBench-EN<sub>test</sub>qwen2-vl-7b-instructunsloth34Qwen/Qwen2-VL-7B-Instruct81.7
Qwen2-VL-7B-InstructmediumMMBench-EN<sub>test</sub>qwen2-vl-7b-instructunsloth35Qwen/Qwen2-VL-7B-Instruct81.7
Qwen2-VL-7B-InstructmediumMMBench-CN<sub>test</sub>qwen2-vl-7bQwen36Qwen/Qwen2-VL-7B81.2
Qwen2-VL-7B-Instruct-unsloth-bnb-4bitmediumMMBench-CN<sub>test</sub>qwen2-vl-7b-instructunsloth37Qwen/Qwen2-VL-7B-Instruct81.2
Qwen2-VL-7B-Instruct-bnb-4bitmediumMMBench-CN<sub>test</sub>qwen2-vl-7b-instructunsloth38Qwen/Qwen2-VL-7B-Instruct81.2
Qwen2-VL-7B-InstructmediumMMBench-CN<sub>test</sub>qwen2-vl-7b-instructunsloth39Qwen/Qwen2-VL-7B-Instruct81.2
Ming-Lite-OmnimediumMMBench_TEST_V11ling-liteinclusionAI40inclusionAI/Ling-lite80.8
Phi-3-vision-128k-instructmediumMMBenchUnknownmicrosoft41microsoft/Phi-3-vision-128k-instruct80.5
Qwen2.5-VL-7B-InstructmediumMMBench-V1.1-En<sub>test</sub>qwen2-5-vl-7b-instructQwen42Qwen/Qwen2.5-VL-7B-Instruct79.4
Qwen2-VL-7B-InstructmediumMMBench-V1.1<sub>test</sub>qwen2-vl-7bQwen43Qwen/Qwen2-VL-7B79.4
Qwen2.5-VL-7B-Instruct-GGUFmediumMMBench-V1.1-En<sub>test</sub>qwen2-5-vl-7b-instructunsloth44Qwen/Qwen2.5-VL-7B-Instruct79.4
Qwen2.5-VL-7B-InstructmediumMMBench-V1.1-En<sub>test</sub>qwen2-5-vl-7b-instructunsloth45Qwen/Qwen2.5-VL-7B-Instruct79.4
Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bitmediumMMBench-V1.1-En<sub>test</sub>qwen2-5-vl-7b-instructunsloth46Qwen/Qwen2.5-VL-7B-Instruct79.4
Qwen2.5-VL-7B-Instruct-bnb-4bitmediumMMBench-V1.1-En<sub>test</sub>qwen2-5-vl-7b-instructunsloth47Qwen/Qwen2.5-VL-7B-Instruct79.4
Qwen2-VL-7B-Instruct-unsloth-bnb-4bitmediumMMBench-V1.1<sub>test</sub>qwen2-vl-7b-instructunsloth48Qwen/Qwen2-VL-7B-Instruct79.4
Qwen2.5-VL-7B-Instruct-GGUFmediumMMBench-V1.1-En<sub>test</sub>qwen2-5-vl-7b-instructMungert49Qwen/Qwen2.5-VL-7B-Instruct79.4
Qwen2-VL-7B-Instruct-bnb-4bitmediumMMBench-V1.1<sub>test</sub>qwen2-vl-7b-instructunsloth50Qwen/Qwen2-VL-7B-Instruct79.4
Qwen2-VL-7B-InstructmediumMMBench-V1.1<sub>test</sub>qwen2-vl-7b-instructunsloth51Qwen/Qwen2-VL-7B-Instruct79.4
Qwen2.5-VL-3B-InstructmediumMMBench-V1.1<sub>test</sub>qwen2-5-vl-3b-instructQwen52Qwen/Qwen2.5-VL-3B-Instruct79.3
Qwen2.5-VL-3B-Instruct-unsloth-bnb-4bitmediumMMBench-V1.1<sub>test</sub>qwen2-5-vl-3b-instructunsloth53Qwen/Qwen2.5-VL-3B-Instruct79.3
Qwen2.5-VL-3B-Instruct-GGUFmediumMMBench-V1.1<sub>test</sub>qwen2-5-vl-3b-instructunsloth54Qwen/Qwen2.5-VL-3B-Instruct79.3
Qwen2.5-VL-3B-Instruct-GGUFmediumMMBench-V1.1<sub>test</sub>qwen2-5-vl-3b-instructMungert55Qwen/Qwen2.5-VL-3B-Instruct79.3
Qwen2.5-VL-3B-Instruct-bnb-4bitmediumMMBench-V1.1<sub>test</sub>qwen2-5-vl-3b-instructunsloth56Qwen/Qwen2.5-VL-3B-Instruct79.3
Qwen2.5-VL-3B-InstructmediumMMBench-V1.1<sub>test</sub>qwen2-5-vl-3b-instructunsloth57Qwen/Qwen2.5-VL-3B-Instruct79.3
jina-vlmmediumUnknownqwen3-1-7b-basejinaai58Qwen/Qwen3-1.7B-Base74.3
falcon-11B-vlmlowUnknownUnknowntiiuae59tiiuae/falcon-11B-vlm72
LFM2.5-VL-1.6B-GGUFlowUnknownUnknownunsloth60LiquidAI/LFM2.5-VL-1.6B65.9
cogvlm2-llama3-chat-19BlowOpen Sourcecogvlm2-llama3-chat-19bzai-org61zai-org/cogvlm2-llama3-chat-19B65.8
cogvlm2-llama3-chinese-chat-19BlowOpen SourceUnknownzai-org62zai-org/cogvlm2-llama3-chinese-chat-19B65.8
cogvlm2-llama3-chat-19B-int4lowOpen Sourcecogvlm2-llama3-chat-19bzai-org63zai-org/cogvlm2-llama3-chat-19B65.8
Qwen2.5-VL-32B-InstructmediumMMBench-Videoqwen2-5-vl-32b-instructQwen64Qwen/Qwen2.5-VL-32B-Instruct2.02
Qwen2.5-VL-32B-Instruct-GGUFmediumMMBench-Videoqwen2-5-vl-32b-instructunsloth65Qwen/Qwen2.5-VL-32B-Instruct2.02
Qwen2.5-VL-32B-Instruct-bnb-4bitmediumMMBench-Videoqwen2-5-vl-32b-instructunsloth66Qwen/Qwen2.5-VL-32B-Instruct2.02
Qwen2.5-VL-32B-Instruct-GGUFmediumMMBench-Videoqwen2-5-vl-32b-instructMungert67Qwen/Qwen2.5-VL-32B-Instruct2.02
Qwen2.5-VL-32B-Instruct-unsloth-bnb-4bitmediumMMBench-Videoqwen2-5-vl-32b-instructunsloth68Qwen/Qwen2.5-VL-32B-Instruct2.02
Qwen2.5-VL-3B-InstructmediumMMBench-Videoqwen2-5-vl-3b-instructQwen69Qwen/Qwen2.5-VL-3B-Instruct1.73
Qwen2.5-VL-3B-Instruct-unsloth-bnb-4bitmediumMMBench-Videoqwen2-5-vl-3b-instructunsloth70Qwen/Qwen2.5-VL-3B-Instruct1.73
Qwen2.5-VL-3B-Instruct-GGUFmediumMMBench-Videoqwen2-5-vl-3b-instructunsloth71Qwen/Qwen2.5-VL-3B-Instruct1.73
Qwen2.5-VL-3B-Instruct-GGUFmediumMMBench-Videoqwen2-5-vl-3b-instructMungert72Qwen/Qwen2.5-VL-3B-Instruct1.73
Qwen2.5-VL-3B-Instruct-bnb-4bitmediumMMBench-Videoqwen2-5-vl-3b-instructunsloth73Qwen/Qwen2.5-VL-3B-Instruct1.73
Qwen2.5-VL-3B-InstructmediumMMBench-Videoqwen2-5-vl-3b-instructunsloth74Qwen/Qwen2.5-VL-3B-Instruct1.73
Qwen2.5-VL-72B-InstructmediumMMBench-Videoqwen2-5-vl-72b-instructQwen75Qwen/Qwen2.5-VL-72B-Instruct1.63
Qwen2.5-VL-72B-Instruct-GGUFmediumMMBench-Videoqwen2-5-vl-72b-instructunsloth76Qwen/Qwen2.5-VL-72B-Instruct1.63
Qwen2.5-VL-72B-Instruct-GGUFmediumMMBench-Videoqwen2-5-vl-72b-instructMungert77Qwen/Qwen2.5-VL-72B-Instruct1.63
Qwen2.5-VL-72B-Instruct-bnb-4bitmediumMMBench-Videoqwen2-5-vl-72b-instructunsloth78Qwen/Qwen2.5-VL-72B-Instruct1.63
Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bitmediumMMBench-Videoqwen2-5-vl-72b-instructunsloth79Qwen/Qwen2.5-VL-72B-Instruct1.63
Qwen2.5-VL-7B-InstructmediumMMBench-Videoqwen2-5-vl-7b-instructQwen80Qwen/Qwen2.5-VL-7B-Instruct1.44
Qwen2.5-VL-7B-Instruct-GGUFmediumMMBench-Videoqwen2-5-vl-7b-instructunsloth81Qwen/Qwen2.5-VL-7B-Instruct1.44
Qwen2.5-VL-7B-InstructmediumMMBench-Videoqwen2-5-vl-7b-instructunsloth82Qwen/Qwen2.5-VL-7B-Instruct1.44
Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bitmediumMMBench-Videoqwen2-5-vl-7b-instructunsloth83Qwen/Qwen2.5-VL-7B-Instruct1.44
Qwen2.5-VL-7B-Instruct-bnb-4bitmediumMMBench-Videoqwen2-5-vl-7b-instructunsloth84Qwen/Qwen2.5-VL-7B-Instruct1.44
Qwen2.5-VL-7B-Instruct-GGUFmediumMMBench-Videoqwen2-5-vl-7b-instructMungert85Qwen/Qwen2.5-VL-7B-Instruct1.44
Provenance & metadata (1)

source

kind
leaderboard-scrape
paths
benchmarks/mmbench.html