Local AI Registry

Leaderboard

OSWorld

osworld
JSON APIBack to leaderboard search

Record

Category
agentic
Scored models
17

Scores

ModelScore
Qwen/Qwen3-VL-30B-A3B-Thinking76.1
inclusionAI/VISTA-9B54.4
inclusionAI/VISTA-4B54.4
Qwen/Qwen3-VL-30B-A3B-Thinking37.4
moonshotai/Kimi-VL-A3B-Instruct31.5
Qwen/Qwen2.5-VL-72B-Instruct14.9
Qwen/Qwen2.5-VL-72B-Instruct14.9
Qwen/Qwen2.5-VL-72B-Instruct14.9
Qwen/Qwen2.5-VL-72B-Instruct14.9
Qwen/Qwen2.5-VL-72B-Instruct14.9
Qwen/Qwen2.5-VL-32B-Instruct8.83
Qwen/Qwen2.5-VL-32B-Instruct8.83
Qwen/Qwen2.5-VL-32B-Instruct8.83
Qwen/Qwen2.5-VL-32B-Instruct8.83
Qwen/Qwen2.5-VL-32B-Instruct8.83
moonshotai/Moonlight-16B-A3B5.03
moonshotai/Kimi-K32

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category
agentic
id
osworld
name
OSWorld
schema version
local-ai-registry/v1

rows

variantconfcontextmodel idorgrankrootscore
Holo2-30B-A3B-GGUFhighGround-UI-1KUnknownMungert1Qwen/Qwen3-VL-30B-A3B-Thinking76.1
VISTA-9BlowUnknownUnknowninclusionAI2inclusionAI/VISTA-9B54.4
VISTA-4BlowUnknownUnknowninclusionAI3inclusionAI/VISTA-4B54.4
Holo2-30B-A3B-GGUFhighUnknownUnknownMungert4Qwen/Qwen3-VL-30B-A3B-Thinking37.4
Kimi-VL-A3B-Thinking-2506mediumOSWorld-G (Acc)kimi-vl-a3b-instructmoonshotai5moonshotai/Kimi-VL-A3B-Instruct31.5
Qwen2.5-VL-72B-InstructmediumOSWorldqwen2-5-vl-72b-instructQwen6Qwen/Qwen2.5-VL-72B-Instruct14.9
Qwen2.5-VL-72B-Instruct-GGUFmediumOSWorldqwen2-5-vl-72b-instructunsloth7Qwen/Qwen2.5-VL-72B-Instruct14.9
Qwen2.5-VL-72B-Instruct-GGUFmediumOSWorldqwen2-5-vl-72b-instructMungert8Qwen/Qwen2.5-VL-72B-Instruct14.9
Qwen2.5-VL-72B-Instruct-bnb-4bitmediumOSWorldqwen2-5-vl-72b-instructunsloth9Qwen/Qwen2.5-VL-72B-Instruct14.9
Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bitmediumOSWorldqwen2-5-vl-72b-instructunsloth10Qwen/Qwen2.5-VL-72B-Instruct14.9
Qwen2.5-VL-32B-InstructmediumOSWorldqwen2-5-vl-32b-instructQwen11Qwen/Qwen2.5-VL-32B-Instruct8.83
Qwen2.5-VL-32B-Instruct-GGUFmediumOSWorldqwen2-5-vl-32b-instructunsloth12Qwen/Qwen2.5-VL-32B-Instruct8.83
Qwen2.5-VL-32B-Instruct-bnb-4bitmediumOSWorldqwen2-5-vl-32b-instructunsloth13Qwen/Qwen2.5-VL-32B-Instruct8.83
Qwen2.5-VL-32B-Instruct-GGUFmediumOSWorldqwen2-5-vl-32b-instructMungert14Qwen/Qwen2.5-VL-32B-Instruct8.83
Qwen2.5-VL-32B-Instruct-unsloth-bnb-4bitmediumOSWorldqwen2-5-vl-32b-instructunsloth15Qwen/Qwen2.5-VL-32B-Instruct8.83
Kimi-VL-A3B-InstructmediumOSWorld (Pass@1)Unknownmoonshotai16moonshotai/Moonlight-16B-A3B5.03
Kimi-K3mediumUnknownUnknownmoonshotai17moonshotai/Kimi-K32
Provenance & metadata (1)

source

kind
leaderboard-scrape
paths
benchmarks/osworld.html