Leaderboard
MedQA
medqaRecord
- Category
- domain
- Scored models
- 40
Scores
| Model | Score |
|---|---|
| — | 88.85 |
| google/medgemma-27b-text-it | 74.9 |
| google/gemma-3-27b-pt | 74.9 |
| google/medgemma-27b-text-it | 74.9 |
| google/medgemma-4b-it | 74.9 |
| google/gemma-3-4b-pt | 74.9 |
| google/medgemma-27b-text-it | 74.9 |
| google/medgemma-4b-it | 74.9 |
| google/medgemma-27b-text-it | 74.9 |
| google/gemma-3-27b-pt | 74.9 |
| google/gemma-3-4b-pt | 74.9 |
| google/medgemma-4b-pt | 74.9 |
| microsoft/GRIN-MoE | 70.4 |
| epfl-llm/meditron-70b | 70.2 |
| epfl-llm/meditron-70b | 70.2 |
| microsoft/Phi-3-medium-4k-instruct | 69.9 |
| allenai/Olmo-3-1125-32B | 68.4 |
| microsoft/Phi-3-medium-128k-instruct | 67.6 |
| microsoft/Phi-3-small-8k-instruct | 65.4 |
| epfl-llm/meditron-70b | 64.4 |
| epfl-llm/meditron-70b | 64.4 |
| m42-health/med42-70b | 61.5 |
| epfl-llm/meditron-7b | 52 |
| google/medgemma-1.5-4b-it | 50.7 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- domain
- id
- medqa
- name
- MedQA
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| II-Medical-8B-1706-GGUF | low | Unknown | Unknown | Mungert | 1 | — | 88.85 |
| medgemma-27b-text-it-bnb-4bit | medium | MedQA (4-op) | medgemma-27b-text-it | unsloth | 2 | google/medgemma-27b-text-it | 74.9 |
| medgemma-27b-text-it | medium | MedQA (4-op) | gemma-3-27b-pt | 3 | google/gemma-3-27b-pt | 74.9 | |
| medgemma-27b-text-it-GGUF | medium | MedQA (4-op) | medgemma-27b-text-it | unsloth | 4 | google/medgemma-27b-text-it | 74.9 |
| medgemma-4b-it-unsloth-bnb-4bit | medium | MedQA (4-op) | medgemma-4b-it | unsloth | 5 | google/medgemma-4b-it | 74.9 |
| medgemma-4b-pt | medium | MedQA (4-op) | gemma-3-4b-pt | 6 | google/gemma-3-4b-pt | 74.9 | |
| medgemma-27b-text-it-unsloth-bnb-4bit | medium | MedQA (4-op) | medgemma-27b-text-it | unsloth | 7 | google/medgemma-27b-text-it | 74.9 |
| medgemma-4b-it-bnb-4bit | medium | MedQA (4-op) | medgemma-4b-it | unsloth | 8 | google/medgemma-4b-it | 74.9 |
| medgemma-27b-text-it | medium | MedQA (4-op) | medgemma-27b-text-it | unsloth | 9 | google/medgemma-27b-text-it | 74.9 |
| medgemma-27b-text-it-GGUF | medium | MedQA (4-op) | gemma-3-27b-pt | Mungert | 10 | google/gemma-3-27b-pt | 74.9 |
| medgemma-4b-pt-GGUF | medium | MedQA (4-op) | gemma-3-4b-pt | Mungert | 11 | google/gemma-3-4b-pt | 74.9 |
| medgemma-4b-pt | medium | MedQA (4-op) | medgemma-4b-pt | unsloth | 12 | google/medgemma-4b-pt | 74.9 |
| GRIN-MoE | medium | MedQA | grin-moe | microsoft | 13 | microsoft/GRIN-MoE | 70.4 |
| meditron-70B-GGUF | medium | MedQA-4-Option | meditron-70b | TheBloke | 14 | epfl-llm/meditron-70b | 70.2 |
| meditron-70B-GPTQ | medium | MedQA-4-Option | meditron-70b | TheBloke | 15 | epfl-llm/meditron-70b | 70.2 |
| Phi-3-medium-4k-instruct | medium | MedQA<br>2-shot | phi-3-medium-4k-instruct | microsoft | 16 | microsoft/Phi-3-medium-4k-instruct | 69.9 |
| Olmo-3-1125-32B | low | Unknown | olmo-3-1125-32b | allenai | 17 | allenai/Olmo-3-1125-32B | 68.4 |
| Phi-3-medium-128k-instruct | medium | MedQA<br>2-shot | phi-3-medium-128k-instruct | microsoft | 18 | microsoft/Phi-3-medium-128k-instruct | 67.6 |
| Phi-3-small-8k-instruct | medium | MedQA<br>2-shot | phi-3-small-8k-instruct | microsoft | 19 | microsoft/Phi-3-small-8k-instruct | 65.4 |
| meditron-70B-GGUF | medium | MedQA | meditron-70b | TheBloke | 20 | epfl-llm/meditron-70b | 64.4 |
| meditron-70B-GPTQ | medium | MedQA | meditron-70b | TheBloke | 21 | epfl-llm/meditron-70b | 64.4 |
| med42-70B-GGUF | medium | MedQA | Unknown | TheBloke | 22 | m42-health/med42-70b | 61.5 |
| meditron-7B-GGUF | medium | MedQA-4-Option | Unknown | TheBloke | 23 | epfl-llm/meditron-7b | 52 |
| medgemma-1.5-4b-it | medium | MedQA (4-op) | medgemma-1-5-4b-it | 24 | google/medgemma-1.5-4b-it | 50.7 | |
| medgemma-4b-it | medium | MedQA (4-op) | medgemma-4b-pt | 25 | google/medgemma-4b-pt | 50.7 | |
| medgemma-27b-it | medium | MedQA (4-op) | gemma-3-27b-pt | 26 | google/gemma-3-27b-pt | 50.7 | |
| medgemma-4b-it-GGUF | medium | MedQA (4-op) | medgemma-4b-it | unsloth | 27 | google/medgemma-4b-it | 50.7 |
| medgemma-1.5-4b-it-GGUF | medium | MedQA (4-op) | medgemma-1-5-4b-it | unsloth | 28 | google/medgemma-1.5-4b-it | 50.7 |
| medgemma-1.5-4b-it | medium | MedQA (4-op) | medgemma-1-5-4b-it | unsloth | 29 | google/medgemma-1.5-4b-it | 50.7 |
| medgemma-27b-it-GGUF | medium | MedQA (4-op) | Unknown | unsloth | 30 | google/medgemma-27b-it | 50.7 |
| medgemma-4b-it | medium | MedQA (4-op) | medgemma-4b-it | unsloth | 31 | google/medgemma-4b-it | 50.7 |
| medgemma-1.5-4b-it-bnb-4bit | medium | MedQA (4-op) | medgemma-1-5-4b-it | unsloth | 32 | google/medgemma-1.5-4b-it | 50.7 |
| medgemma-27b-it | medium | MedQA (4-op) | Unknown | unsloth | 33 | google/medgemma-27b-it | 50.7 |
| medgemma-1.5-4b-it-unsloth-bnb-4bit | medium | MedQA (4-op) | medgemma-1-5-4b-it | unsloth | 34 | google/medgemma-1.5-4b-it | 50.7 |
| medgemma-4b-it-GGUF | medium | MedQA (4-op) | medgemma-4b-pt | Mungert | 35 | google/medgemma-4b-pt | 50.7 |
| meditron-7B-GGUF | medium | MedQA | Unknown | TheBloke | 36 | epfl-llm/meditron-7b | 47.9 |
| Olmo-3-1025-7B | low | Unknown | olmo-3-1025-7b | allenai | 37 | allenai/Olmo-3-1025-7B | 47.3 |
| Olmo-Hybrid-7B | low | Unknown | olmo-hybrid-7b | allenai | 38 | allenai/Olmo-Hybrid-7B | 47.3 |
| Olmo-3-1025-7B-GGUF | low | Unknown | olmo-3-1025-7b | Mungert | 39 | allenai/Olmo-3-1025-7B | 47.3 |
| Phi-3-small-128k-instruct | medium | MedQA<br>2-shot | phi-3-small-128k-instruct | microsoft | 40 | microsoft/Phi-3-small-128k-instruct | 46.3 |
Provenance & metadata (1)
source
- kind
- leaderboard-scrape
- paths
- benchmarks/medqa.html