Leaderboard
SWE-bench Live Lite (2025-05-01 snapshot)
swebench-live-2025-05-01-liteRecord
- Category
- swe
- Scored models
- 1
Scores
| Model | Score |
|---|---|
| deepseek-ai/DeepSeek-V3 | 13.3 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- swe
- id
- swebench-live-2025-05-01-lite
- name
- SWE-bench Live Lite (2025-05-01 snapshot)
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| DeepSeek-V3 | high | SWE-bench Live Lite; 40/300 resolved; Agentless; evaluated 2025-05-01 | deepseek-v3 | deepseek-ai | 1 | deepseek-ai/DeepSeek-V3 | 13.3 |
Provenance & metadata (1)
source
- kind
- official-benchmark-leaderboard
- paths
- reports-0605.jsonl