Leaderboard
GPQA-Main
gpqa-mainRecord
- Category
- reasoning
- Scored models
- 6
Scores
| Model | Score |
|---|---|
| mistralai/Mistral-Small-24B-Base-2501 | 45.3 |
| mistralai/Mistral-Small-24B-Instruct-2501 | 45.3 |
| mistralai/Mistral-Small-24B-Instruct-2501 | 45.3 |
| mistralai/Mistral-Small-24B-Instruct-2501 | 45.3 |
| mistralai/Mistral-Small-24B-Instruct-2501 | 45.3 |
| mistralai/Mistral-Small-24B-Base-2501 | 45.3 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- reasoning
- id
- gpqa-main
- name
- GPQA-Main
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| Mistral-Small-24B-Instruct-2501 | medium | gpqa_main_cot_5shot_instruct | mistral-small-24b-base-2501 | mistralai | 1 | mistralai/Mistral-Small-24B-Base-2501 | 45.3 |
| Mistral-Small-24B-Instruct-2501-bnb-4bit | medium | gpqa_main_cot_5shot_instruct | mistral-small-24b-instruct-2501 | unsloth | 2 | mistralai/Mistral-Small-24B-Instruct-2501 | 45.3 |
| Mistral-Small-24B-Instruct-2501-GGUF | medium | gpqa_main_cot_5shot_instruct | mistral-small-24b-instruct-2501 | unsloth | 3 | mistralai/Mistral-Small-24B-Instruct-2501 | 45.3 |
| Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit | medium | gpqa_main_cot_5shot_instruct | mistral-small-24b-instruct-2501 | unsloth | 4 | mistralai/Mistral-Small-24B-Instruct-2501 | 45.3 |
| Mistral-Small-24B-Instruct-2501 | medium | gpqa_main_cot_5shot_instruct | mistral-small-24b-instruct-2501 | unsloth | 5 | mistralai/Mistral-Small-24B-Instruct-2501 | 45.3 |
| Mistral-Small-24B-Base-2501-unsloth-bnb-4bit | medium | gpqa_main_cot_5shot_instruct | mistral-small-24b-base-2501 | unsloth | 6 | mistralai/Mistral-Small-24B-Base-2501 | 45.3 |
Provenance & metadata (1)
source
- kind
- leaderboard-scrape
- paths
- benchmarks/gpqa-main.html