Leaderboard
WER FLEURS
wer-fleursRecord
- Category
- speech-asr
- Scored models
- 183
Scores
| Model | Score |
|---|---|
| — | 100 |
| — | 100 |
| openai/whisper-large-v3 | 99.69 |
| — | 98.7 |
| — | 97.18 |
| — | 97.18 |
| FireRedTeam/FireRedLID | 97.18 |
| FireRedTeam/FireRedPunc | 97.18 |
| UsefulSensors/moonshine-tiny-zh | 71.1 |
| openai/whisper-large-v3 | 65.99 |
| openai/whisper-large-v3 | 59.2 |
| openai/whisper-base | 59.2 |
| openai/whisper-small | 59.2 |
| openai/whisper-tiny | 59.2 |
| openai/whisper-medium | 59.2 |
| openai/whisper-large-v3 | 50.84 |
| openai/whisper-large-v3-turbo | 50.84 |
| UsefulSensors/moonshine-tiny-ja | 47.2 |
| openai/whisper-base | 35.09 |
| nvidia/nemotron-3.5-asr-streaming-0.6b | 33.07 |
| openai/whisper-small | 30.29 |
| openai/whisper-medium | 26.33 |
| openai/whisper-large-v3-turbo | 25.5 |
| — | 22.4 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- speech-asr
- id
- wer-fleurs
- name
- WER FLEURS
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| TrorYongASR-small | high | Unknown | Unknown | KrorngAI | 1 | — | 100 |
| TrorYongASR-tiny | high | Unknown | Unknown | KrorngAI | 2 | — | 100 |
| MERaLiON-3-10B | medium | fleurs | whisper-large-v3 | MERaLiON | 3 | openai/whisper-large-v3 | 99.69 |
| kotoba-whisper-bilingual-v1.0 | low | Unknown | Unknown | kotoba-tech | 4 | — | 98.7 |
| FireRedLID-vllm | medium | FLEURS test | Unknown | PatchyTisa | 5 | — | 97.18 |
| FireRedASR2-LLM-vllm | medium | FLEURS test | Unknown | allendou | 6 | — | 97.18 |
| FireRedLID | medium | FLEURS test | Unknown | FireRedTeam | 7 | FireRedTeam/FireRedLID | 97.18 |
| FireRedPunc | medium | FLEURS test | Unknown | FireRedTeam | 8 | FireRedTeam/FireRedPunc | 97.18 |
| moonshine-tiny-zh | low | Unknown | Unknown | UsefulSensors | 9 | UsefulSensors/moonshine-tiny-zh | 71.1 |
| whisper-large-v3-turbo-hr-parla | medium | google/fleurs hr_hr test | whisper-large-v3 | GoranS | 10 | openai/whisper-large-v3 | 65.99 |
| kb-whisper-large | high | Unknown | whisper-large-v3 | KBLab | 11 | openai/whisper-large-v3 | 59.2 |
| kb-whisper-base | high | Unknown | whisper-base | KBLab | 12 | openai/whisper-base | 59.2 |
| kb-whisper-small | high | Unknown | whisper-small | KBLab | 13 | openai/whisper-small | 59.2 |
| kb-whisper-tiny | high | Unknown | whisper-tiny | KBLab | 14 | openai/whisper-tiny | 59.2 |
| kb-whisper-medium | high | Unknown | whisper-medium | KBLab | 15 | openai/whisper-medium | 59.2 |
| Whisper-Hindi2Hinglish-Prime | medium | [FLEURS](https://huggingface.co/datasets/google/fleurs) | whisper-large-v3 | Oriserve | 16 | openai/whisper-large-v3 | 50.84 |
| Whisper-Hindi2Hinglish-Apex | medium | [FLEURS](https://huggingface.co/datasets/google/fleurs) | whisper-large-v3-turbo | Oriserve | 17 | openai/whisper-large-v3-turbo | 50.84 |
| moonshine-tiny-ja | low | Unknown | Unknown | UsefulSensors | 18 | UsefulSensors/moonshine-tiny-ja | 47.2 |
| Whisper-Hindi2Hinglish-Swift | medium | [FLEURS](https://huggingface.co/datasets/google/fleurs) | whisper-base | Oriserve | 19 | openai/whisper-base | 35.09 |
| nemotron-3.5-asr-streaming-slovenian | medium | FLEURS sl | nemotron-3-5-asr-streaming-0-6b | texdata | 20 | nvidia/nemotron-3.5-asr-streaming-0.6b | 33.07 |
| code-switched-egyptian-arabic-whisper-small | medium | FLEURS ar\_eg test set (transcription column) | whisper-small | IbrahimAmin | 21 | openai/whisper-small | 30.29 |
| whisper-medium-uzbek | low | Unknown | whisper-medium | navai-uz | 22 | openai/whisper-medium | 26.33 |
| whisper-large-v3-turbo-lt | medium | **FLEURS-lt** (test, n=986) | whisper-large-v3-turbo | svogunas | 23 | openai/whisper-large-v3-turbo | 25.5 |
| heep-indic | medium | FLEURS | Unknown | bc7ec356 | 24 | — | 22.4 |
| wav2vec2-large-mms-1b-hungarian | medium | FLEURS (hu) Test | mms-1b-all | GaborMadarasz | 25 | facebook/mms-1b-all | 19.93 |
| indic_whisper_nodcil | low | Unknown | Unknown | parthiv11 | 26 | — | 19.4 |
| heep-indic | low | Unknown | Unknown | bc7ec356 | 27 | — | 19.4 |
| SraVaani-1.0 | low | Unknown | Unknown | ARTPARK-IISc | 28 | — | 18.8 |
| central-kurdish-tts | medium | FLEURS | Unknown | aranemini | 29 | — | 18.5 |
| stt_uz_fastconformer_hybrid_large_pc | medium | **FLEURS DEV (used as test)** | Unknown | nvidia | 30 | nvidia/stt_uz_fastconformer_hybrid_large_pc | 17.52 |
| moonshine-base-zh-gguf | low | Unknown | Unknown | handy-computer | 31 | UsefulSensors/moonshine-base-zh | 16.65 |
| Whisper-Large-v3-Turbo-CoreML | medium | `fleurs-ar_eg` | whisper-large-v3-turbo | aufklarer | 32 | openai/whisper-large-v3-turbo | 16.6 |
| moonshine-tiny-ko | low | Unknown | moonshine-tiny-ko | UsefulSensors | 33 | UsefulSensors/moonshine-tiny-ko | 15.83 |
| moonshine-tiny-ko-ONNX | low | Unknown | moonshine-tiny-ko | onnx-community | 34 | UsefulSensors/moonshine-tiny-ko | 15.83 |
| Nos_ASR-wav2vec2-xls-r-300m-gl | medium | FLEURS | Unknown | proxectonos | 35 | facebook/wav2vec2-xls-r-300m | 15.83 |
| IndicConformer-GGUF | low | Unknown | Unknown | Singla0009 | 36 | ai4bharat/indicconformer_stt_hi_hybrid_rnnt_large | 15.2 |
| whisper-small-cv11-french | low | Unknown | Unknown | bofenghuang | 37 | — | 15 |
| moonshine-tiny-zh-gguf | low | Unknown | Unknown | handy-computer | 38 | UsefulSensors/moonshine-tiny-zh | 13.7 |
| whisper-turbo-kaz-rus-v1 | high | Unknown | Unknown | abilmansplus | 39 | abilmansplus/whisper-turbo-ksc2 | 13.6 |
| stt_ka_fastconformer_hybrid_large_pc | low | Unknown | Unknown | nvidia | 40 | nvidia/stt_ka_fastconformer_hybrid_large_pc | 13.44 |
| Whisper_Largev2-Swahili-Decodis_Base | medium | **FLEURS (benchmark)** | whisper-large-v2 | RafatK | 41 | openai/whisper-large-v2 | 13.31 |
| moonshine-tiny-ja-gguf | low | Unknown | Unknown | handy-computer | 42 | UsefulSensors/moonshine-tiny-ja | 13.2 |
| whisper-hinglish-preview | medium | FLEURS-hi | Unknown | Trelis | 43 | ARTPARK-IISc/whisper-large-v3-vaani-hindi | 12.57 |
| Whisper_Largev2-Swahili-Decodis_Comb_FT | medium | **FLEURS (benchmark)** | whisper-large-v2 | RafatK | 44 | openai/whisper-large-v2 | 12.41 |
| parakeet-tdt-0.6b-v3-gguf | low | Unknown | parakeet-tdt-0-6b-v3 | handy-computer | 45 | nvidia/parakeet-tdt-0.6b-v3 | 11.97 |
| parakeet-tdt-0.6b-v3 | low | Unknown | parakeet-tdt-0-6b-v3 | nvidia | 46 | nvidia/parakeet-tdt-0.6b-v3 | 11.97 |
| whisper-large-v3-vaani-hindi | medium | Fleurs | whisper-small | ARTPARK-IISc | 47 | openai/whisper-small | 11.2 |
| moonshine-base-ja-gguf | low | Unknown | Unknown | handy-computer | 48 | UsefulSensors/moonshine-base-ja | 10.84 |
| polyglot-lion-1.7b | low | Unknown | qwen3-asr-1-7b | knoveleng | 49 | Qwen/Qwen3-ASR-1.7B | 10.63 |
| polyglot-lion-1.7b-v1.5 | low | Unknown | qwen3-asr-1-7b | knoveleng | 50 | Qwen/Qwen3-ASR-1.7B | 10.63 |
| parakeet-rnnt-110m-da-dk | medium | Google FLEURS | Unknown | nvidia | 51 | nvidia/parakeet-rnnt-110m-da-dk | 10.6 |
| tara | medium | [FLEURS-hi](https://huggingface.co/datasets/Trelis/vistaar-hi-fleurs-test) | Unknown | Trelis | 52 | — | 10.47 |
| whisper-hinglish-preview | medium | cs-fleurs (read CS) | Unknown | Trelis | 53 | ARTPARK-IISc/whisper-large-v3-vaani-hindi | 10.19 |
| resilientai-team-mcte-mistral-voxtral-realtime-gptq-marlin | medium | FLEURS (`google/fleurs`) | voxtral-mini-4b-realtime-2602 | JaynadTodkarAmol | 54 | mistralai/Voxtral-Mini-4B-Realtime-2602 | 10 |
| stt_tl_fastconformer_hybrid_large | low | Unknown | Unknown | NCSpeech | 55 | — | 9.34 |
| moonshine-tiny-ko-gguf | low | Unknown | moonshine-tiny-ko | handy-computer | 56 | UsefulSensors/moonshine-tiny-ko | 8.97 |
| parakeet-tdt-0.6b-v3-fr-tv-media | medium | **Fleurs (FR)** | parakeet-tdt-0-6b-v3 | Archime | 57 | nvidia/parakeet-tdt-0.6b-v3 | 8.71 |
| canary-1b-v2-gguf | low | Unknown | Unknown | handy-computer | 58 | nvidia/canary-1b-v2 | 8.4 |
| canary-1b-v2 | low | Unknown | Unknown | nvidia | 59 | nvidia/canary-1b-v2 | 8.4 |
| canary-1b-v2-gguf | low | Unknown | Unknown | memoravox | 60 | nvidia/canary-1b-v2 | 8.4 |
| tara | medium | [Code-Switch FLEURS hi-en](https://huggingface.co/datasets/Trelis/cs-fleurs-hineng-read-test) (read CS) | Unknown | Trelis | 61 | — | 8.37 |
| Breeze-ASR-25-gguf | low | Unknown | Unknown | handy-computer | 62 | MediaTek-Research/Breeze-ASR-25 | 8.12 |
| gemma-4-26B-A4B-it | medium | FLEURS (lower is better) | gemma-4-26b-a4b | 63 | google/gemma-4-26B-A4B | 8 | |
| gemma-4-31B-it | medium | FLEURS (lower is better) | gemma-4-31b | 64 | google/gemma-4-31B | 8 | |
| gemma-4-E4B-it | medium | FLEURS (lower is better) | gemma-4-e4b | 65 | google/gemma-4-E4B | 8 | |
| gemma-4-E2B-it | medium | FLEURS (lower is better) | gemma-4-e2b | 66 | google/gemma-4-E2B | 8 | |
| gemma-4-12B-it | medium | FLEURS (lower is better) | gemma-4-12b | 67 | google/gemma-4-12B | 8 | |
| gemma-4-31B-it-qat-w4a16-ct | medium | FLEURS (lower is better) | gemma-4-31b-it-qat-q4-0-unquantized | 68 | google/gemma-4-31B-it-qat-q4_0-unquantized | 8 | |
| gemma-4-12B-it-qat-w4a16-ct | medium | FLEURS (lower is better) | gemma-4-12b-it-qat-q4-0-unquantized | 69 | google/gemma-4-12B-it-qat-q4_0-unquantized | 8 | |
| gemma-4-31B-it-assistant | medium | FLEURS (lower is better) | gemma-4-31b-it-assistant | 70 | google/gemma-4-31B-it-assistant | 8 | |
| gemma-4-26B-A4B-it-GGUF | medium | FLEURS (lower is better) | gemma-4-26b-a4b-it | unsloth | 71 | google/gemma-4-26B-A4B-it | 8 |
| gemma-4-26B-A4B | medium | FLEURS (lower is better) | gemma-4-26b-a4b | 72 | google/gemma-4-26B-A4B | 8 | |
| gemma-4-31B | medium | FLEURS (lower is better) | gemma-4-31b | 73 | google/gemma-4-31B | 8 | |
| gemma-4-12b-it-GGUF | medium | FLEURS (lower is better) | gemma-4-12b-it | unsloth | 74 | google/gemma-4-12B-it | 8 |
| gemma-4-12B-it-qat-q4_0-unquantized | medium | FLEURS (lower is better) | gemma-4-12b-it | 75 | google/gemma-4-12B-it | 8 | |
| gemma-4-31B-it-GGUF | medium | FLEURS (lower is better) | gemma-4-31b-it | unsloth | 76 | google/gemma-4-31B-it | 8 |
| gemma-4-E4B-it-GGUF | medium | FLEURS (lower is better) | gemma-4-e4b-it | unsloth | 77 | google/gemma-4-E4B-it | 8 |
| gemma-4-E2B-it-qat-w4a16-ct | medium | FLEURS (lower is better) | gemma-4-e2b-it-qat-q4-0-unquantized | 78 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 8 | |
| gemma-4-26B-A4B-it-qat-GGUF | medium | FLEURS (lower is better) | gemma-4-26b-a4b-it-qat-q4-0-unquantized | unsloth | 79 | google/gemma-4-26B-A4B-it-qat-q4_0-unquantized | 8 |
| gemma-4-E4B-it-unsloth-bnb-4bit | medium | FLEURS (lower is better) | gemma-4-e4b-it | unsloth | 80 | google/gemma-4-E4B-it | 8 |
| gemma-4-E2B-it-GGUF | medium | FLEURS (lower is better) | gemma-4-e2b | unsloth | 81 | google/gemma-4-E2B-it | 8 |
| gemma-4-E4B-it-qat-w4a16-ct | medium | FLEURS (lower is better) | gemma-4-e4b-it-qat-q4-0-unquantized | 82 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 8 | |
| gemma-4-31B-it-unsloth-bnb-4bit | medium | FLEURS (lower is better) | gemma-4-31b-it | unsloth | 83 | google/gemma-4-31B-it | 8 |
| gemma-4-31B-it-qat-GGUF | medium | FLEURS (lower is better) | gemma-4-31b-it-qat-q4-0-unquantized | unsloth | 84 | google/gemma-4-31B-it-qat-q4_0-unquantized | 8 |
| gemma-4-12B | medium | FLEURS (lower is better) | gemma-4-12b | 85 | google/gemma-4-12B | 8 | |
| gemma-4-E4B-it-qat-GGUF | medium | FLEURS (lower is better) | gemma-4-e4b-it-qat-q4-0-unquantized | unsloth | 86 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 8 |
| gemma-4-26B-A4B-it-assistant | medium | FLEURS (lower is better) | gemma-4-26b-a4b-it-assistant | 87 | google/gemma-4-26B-A4B-it-assistant | 8 | |
| gemma-4-12B-it-qat-GGUF | medium | FLEURS (lower is better) | gemma-4-12b-it-qat-q4-0-unquantized | unsloth | 88 | google/gemma-4-12B-it-qat-q4_0-unquantized | 8 |
| gemma-4-12B-it-qat-q4_0-gguf | medium | FLEURS (lower is better) | gemma-4-12b-it-qat-q4-0-unquantized | 89 | google/gemma-4-12B-it-qat-q4_0-unquantized | 8 | |
| gemma-4-E4B | medium | FLEURS (lower is better) | gemma-4-e4b | 90 | google/gemma-4-E4B | 8 | |
| gemma-4-E4B-it-qat-q4_0-gguf | medium | FLEURS (lower is better) | gemma-4-e4b-it-qat-q4-0-unquantized | 91 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 8 | |
| gemma-4-E2B-it-qat-q4_0-gguf | medium | FLEURS (lower is better) | gemma-4-e2b-it-qat-q4-0-unquantized | 92 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 8 | |
| gemma-4-12B-it-assistant | medium | FLEURS (lower is better) | gemma-4-12b-it-assistant | 93 | google/gemma-4-12B-it-assistant | 8 | |
| gemma-4-E4B-it | medium | FLEURS (lower is better) | gemma-4-e4b-it | unsloth | 94 | google/gemma-4-E4B-it | 8 |
| gemma-4-12b-it | medium | FLEURS (lower is better) | gemma-4-12b-it | unsloth | 95 | google/gemma-4-12B-it | 8 |
| gemma-4-E2B-it-qat-GGUF | medium | FLEURS (lower is better) | gemma-4-e2b-it-qat-q4-0-unquantized | unsloth | 96 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 8 |
| gemma-4-12B-it-qat-q4_0-unquantized-assistant | medium | FLEURS (lower is better) | gemma-4-12b-it-assistant | 97 | google/gemma-4-12B-it-assistant | 8 | |
| gemma-4-26B-A4B-it-qat-q4_0-gguf | medium | FLEURS (lower is better) | gemma-4-26b-a4b-it-qat-q4-0-unquantized | 98 | google/gemma-4-26B-A4B-it-qat-q4_0-unquantized | 8 | |
| gemma-4-E2B | medium | FLEURS (lower is better) | gemma-4-e2b | 99 | google/gemma-4-E2B | 8 | |
| gemma-4-26B-A4B-it-NVFP4 | medium | FLEURS (lower is better) | gemma-4-26b-a4b-it | unsloth | 100 | google/gemma-4-26B-A4B-it | 8 |
| gemma-4-E2B-it-unsloth-bnb-4bit | medium | FLEURS (lower is better) | gemma-4-e2b | unsloth | 101 | google/gemma-4-E2B-it | 8 |
| gemma-4-31B-it-qat-q4_0-gguf | medium | FLEURS (lower is better) | gemma-4-31b-it-qat-q4-0-unquantized | 102 | google/gemma-4-31B-it-qat-q4_0-unquantized | 8 | |
| gemma-4-E2B-it | medium | FLEURS (lower is better) | gemma-4-e2b | unsloth | 103 | google/gemma-4-E2B-it | 8 |
| gemma-4-31B-it-qat-w4a16 | medium | FLEURS (lower is better) | gemma-4-31b-it-qat-q4-0-unquantized | unsloth | 104 | google/gemma-4-31B-it-qat-q4_0-unquantized | 8 |
| gemma-4-E2B-it-assistant | medium | FLEURS (lower is better) | gemma-4-e2b-it-assistant | 105 | google/gemma-4-E2B-it-assistant | 8 | |
| gemma-4-E4B-it-assistant | medium | FLEURS (lower is better) | gemma-4-e4b-it-assistant | 106 | google/gemma-4-E4B-it-assistant | 8 | |
| gemma-4-26B-A4B-it | medium | FLEURS (lower is better) | gemma-4-26b-a4b-it | unsloth | 107 | google/gemma-4-26B-A4B-it | 8 |
| gemma-4-E2B-it-qat-mobile-ct | medium | FLEURS (lower is better) | gemma-4-e2b-it-qat-mobile-transformers | 108 | google/gemma-4-E2B-it-qat-mobile-transformers | 8 | |
| gemma-4-E2B-it-qat-mobile-GGUF | medium | FLEURS (lower is better) | gemma-4-e2b-it-qat-mobile-transformers | unsloth | 109 | google/gemma-4-E2B-it-qat-mobile-transformers | 8 |
| gemma-4-26B-A4B-it-qat-q4_0-unquantized | medium | FLEURS (lower is better) | gemma-4-26b-a4b-it | 110 | google/gemma-4-26B-A4B-it | 8 | |
| gemma-4-E2B-it-qat-q4_0-unquantized | medium | FLEURS (lower is better) | gemma-4-e2b | 111 | google/gemma-4-E2B-it | 8 | |
| gemma-4-E4B-it-qat-mobile-ct | medium | FLEURS (lower is better) | gemma-4-e4b-it-qat-mobile-transformers | 112 | google/gemma-4-E4B-it-qat-mobile-transformers | 8 | |
| gemma-4-12b-it-NVFP4 | medium | FLEURS (lower is better) | gemma-4-12b-it | unsloth | 113 | google/gemma-4-12B-it | 8 |
| gemma-4-31B-it | medium | FLEURS (lower is better) | gemma-4-31b-it | unsloth | 114 | google/gemma-4-31B-it | 8 |
| gemma-4-E4B-it-qat-mobile-GGUF | medium | FLEURS (lower is better) | gemma-4-e4b-it-qat-mobile-transformers | unsloth | 115 | google/gemma-4-E4B-it-qat-mobile-transformers | 8 |
| gemma-4-31B-it-NVFP4 | medium | FLEURS (lower is better) | gemma-4-31b-it | unsloth | 116 | google/gemma-4-31B-it | 8 |
| gemma-4-12b | medium | FLEURS (lower is better) | gemma-4-12b | unsloth | 117 | google/gemma-4-12B | 8 |
| gemma-4-E2B-it-qat-mobile-transformers | medium | FLEURS (lower is better) | gemma-4-e2b | 118 | google/gemma-4-E2B-it | 8 | |
| gemma-4-E4B-it-qat-mobile-transformers | medium | FLEURS (lower is better) | gemma-4-e4b-it | 119 | google/gemma-4-E4B-it | 8 | |
| gemma-4-31B-it-qat-q4_0-unquantized-assistant | medium | FLEURS (lower is better) | gemma-4-31b-it-assistant | 120 | google/gemma-4-31B-it-assistant | 8 | |
| gemma-4-E4B-it-qat-q4_0-unquantized | medium | FLEURS (lower is better) | gemma-4-e4b-it | 121 | google/gemma-4-E4B-it | 8 | |
| gemma-4-26B-A4B-it-qat-q4_0-unquantized-assistant | medium | FLEURS (lower is better) | gemma-4-26b-a4b-it-assistant | 122 | google/gemma-4-26B-A4B-it-assistant | 8 | |
| gemma-4-31B-it-qat-q4_0-unquantized | medium | FLEURS (lower is better) | gemma-4-31b-it | 123 | google/gemma-4-31B-it | 8 | |
| gemma-4-E4B-it-NVFP4 | medium | FLEURS (lower is better) | gemma-4-e4b-it | unsloth | 124 | google/gemma-4-E4B-it | 8 |
| gemma-4-E2B-it-qat-q4_0-unquantized-assistant | medium | FLEURS (lower is better) | gemma-4-e2b-it-assistant | 125 | google/gemma-4-E2B-it-assistant | 8 | |
| gemma-4-E4B-it-qat-q4_0-unquantized-assistant | medium | FLEURS (lower is better) | gemma-4-e4b-it-assistant | 126 | google/gemma-4-E4B-it-assistant | 8 | |
| gemma-4-12B-it-qat-q4_0-unquantized | medium | FLEURS (lower is better) | gemma-4-12b-it | unsloth | 127 | google/gemma-4-12B-it | 8 |
| gemma-4-E2B | medium | FLEURS (lower is better) | gemma-4-e2b | unsloth | 128 | google/gemma-4-E2B | 8 |
| gemma-4-E2B-it-qat-q4_0-unquantized | medium | FLEURS (lower is better) | gemma-4-e2b | unsloth | 129 | google/gemma-4-E2B-it | 8 |
| gemma-4-E2B-it-NVFP4 | medium | FLEURS (lower is better) | gemma-4-e2b | unsloth | 130 | google/gemma-4-E2B-it | 8 |
| gemma-4-12B-it-qat-w4a16 | medium | FLEURS (lower is better) | gemma-4-12b-it-qat-q4-0-unquantized | unsloth | 131 | google/gemma-4-12B-it-qat-q4_0-unquantized | 8 |
| gemma-4-26B-A4B-it-qat-q4_0-unquantized | medium | FLEURS (lower is better) | gemma-4-26b-a4b-it | unsloth | 132 | google/gemma-4-26B-A4B-it | 8 |
| gemma-4-12B-it-GGUF | medium | FLEURS (lower is better) | gemma-4-12b | Mungert | 133 | google/gemma-4-12B | 8 |
| gemma-4-E4B-it-qat-w4a16 | medium | FLEURS (lower is better) | gemma-4-e4b-it-qat-q4-0-unquantized | unsloth | 134 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 8 |
| gemma-4-26b-a4b-it-UD-MLX-4bit | medium | FLEURS (lower is better) | gemma-4-26b-a4b-it | unsloth | 135 | google/gemma-4-26B-A4B-it | 8 |
| gemma-4-26B-A4B | medium | FLEURS (lower is better) | gemma-4-26b-a4b | unsloth | 136 | google/gemma-4-26B-A4B | 8 |
| gemma-4-31B-it-qat-q4_0-unquantized | medium | FLEURS (lower is better) | gemma-4-31b-it | unsloth | 137 | google/gemma-4-31B-it | 8 |
| gemma-4-E2B-it-qat-w4a16 | medium | FLEURS (lower is better) | gemma-4-e2b-it-qat-q4-0-unquantized | unsloth | 138 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 8 |
| gemma-4-E4B | medium | FLEURS (lower is better) | gemma-4-e4b | unsloth | 139 | google/gemma-4-E4B | 8 |
| gemma-4-E4B-it-qat-q4_0-unquantized | medium | FLEURS (lower is better) | gemma-4-e4b-it | unsloth | 140 | google/gemma-4-E4B-it | 8 |
| gemma-4-31B | medium | FLEURS (lower is better) | gemma-4-31b | unsloth | 141 | google/gemma-4-31B | 8 |
| gemma-4-E4B-it-UD-MLX-4bit | medium | FLEURS (lower is better) | gemma-4-e4b-it | unsloth | 142 | google/gemma-4-E4B-it | 8 |
| gemma-4-E2B-it-UD-MLX-4bit | medium | FLEURS (lower is better) | gemma-4-e2b | unsloth | 143 | google/gemma-4-E2B-it | 8 |
| gemma-4-31b-it-MLX-8bit | medium | FLEURS (lower is better) | gemma-4-31b-it | unsloth | 144 | google/gemma-4-31B-it | 8 |
| gemma-4-26b-a4b-it-MLX-8bit | medium | FLEURS (lower is better) | gemma-4-26b-a4b-it | unsloth | 145 | google/gemma-4-26B-A4B-it | 8 |
| gemma-4-31B-it-GGUF | medium | FLEURS (lower is better) | gemma-4-31b | Mungert | 146 | google/gemma-4-31B | 8 |
| gemma-4-E2B-it-qat-mobile | medium | FLEURS (lower is better) | gemma-4-e2b-it-qat-q4-0-unquantized | unsloth | 147 | google/gemma-4-E2B-it-qat-q4_0-unquantized | 8 |
| gemma-4-E4B-it-MLX-8bit | medium | FLEURS (lower is better) | gemma-4-e4b-it | unsloth | 148 | google/gemma-4-E4B-it | 8 |
| gemma-4-31b-it-UD-MLX-4bit | medium | FLEURS (lower is better) | gemma-4-31b-it | unsloth | 149 | google/gemma-4-31B-it | 8 |
| gemma-4-E4B-it-GGUF | medium | FLEURS (lower is better) | gemma-4-e4b | Mungert | 150 | google/gemma-4-E4B | 8 |
| gemma-4-E2B-it-GGUF | medium | FLEURS (lower is better) | gemma-4-e2b | Mungert | 151 | google/gemma-4-E2B | 8 |
| gemma-4-E2B-it-MLX-8bit | medium | FLEURS (lower is better) | gemma-4-e2b | unsloth | 152 | google/gemma-4-E2B-it | 8 |
| gemma-4-26b-a4b-it-UD-MLX-3bit | medium | FLEURS (lower is better) | gemma-4-26b-a4b-it | unsloth | 153 | google/gemma-4-26B-A4B-it | 8 |
| moonshine-base-ko-gguf | low | Unknown | Unknown | handy-computer | 154 | UsefulSensors/moonshine-base-ko | 8 |
| gemma-4-E4B-it-qat-mobile | medium | FLEURS (lower is better) | gemma-4-e4b-it-qat-q4-0-unquantized | unsloth | 155 | google/gemma-4-E4B-it-qat-q4_0-unquantized | 8 |
| gemma-4-31b-it-UD-MLX-3bit | medium | FLEURS (lower is better) | gemma-4-31b-it | unsloth | 156 | google/gemma-4-31B-it | 8 |
| VibeVoice-ASR-BitNet | medium | Fleurs-zh | vibevoice-asr-bitnet | microsoft | 157 | microsoft/VibeVoice-ASR-BitNet | 7.92 |
| parakeet-tdt-0.6b-v3-fr-tv-media | medium | **Fleurs (EN)** | parakeet-tdt-0-6b-v3 | Archime | 158 | nvidia/parakeet-tdt-0.6b-v3 | 7.53 |
| nemotron-3.5-asr-streaming-0.6b-onnx-int4 | high | Unknown | nemotron-3-5-asr-streaming-0-6b | onnx-community | 159 | nvidia/nemotron-3.5-asr-streaming-0.6b | 7.28 |
| w2v-bert-punjabi | medium | Unknown | Unknown | kdcyberdude | 160 | — | 6.96 |
| whisper-hinglish-preview | medium | FLEURS-en | Unknown | Trelis | 161 | ARTPARK-IISc/whisper-large-v3-vaani-hindi | 6.93 |
| parakeet-ctc-0.6b-Vietnamese | low | Unknown | Unknown | nvidia | 162 | nvidia/parakeet-ctc-0.6b-Vietnamese | 6.86 |
| swecha-gonthuka-asr | medium | FLEURS (te_in) | Unknown | swechatelangana | 163 | Harveenchadha/wav2vec2-pretrained-clsril-23-10k | 6.32 |
| Whisper-Large-v3-Turbo-CoreML | medium | `fleurs-fr_fr` | whisper-large-v3-turbo | aufklarer | 164 | openai/whisper-large-v3-turbo | 6.28 |
| Fun-ASR-MLT-Nano-2512-gguf | medium | Fleurs-en | Unknown | handy-computer | 165 | FunAudioLLM/Fun-ASR-MLT-Nano-2512 | 5.78 |
| Fun-ASR-Nano-2512-gguf | medium | Fleurs-en | Unknown | handy-computer | 166 | FunAudioLLM/Fun-ASR-Nano-2512 | 5.78 |
| Fun-ASR-Nano-2512 | medium | Fleurs-en | Unknown | FunAudioLLM | 167 | FunAudioLLM/Fun-ASR-Nano-2512 | 5.78 |
| Fun-ASR-MLT-Nano-2512 | medium | Fleurs-en | Unknown | FunAudioLLM | 168 | FunAudioLLM/Fun-ASR-MLT-Nano-2512 | 5.78 |
| Phi-4-multimodal-instruct | low | fleurs-ko2en-cot | fleurs-en2ko-cot | phi-4-multimodal-instruct | microsoft | 169 | microsoft/Phi-4-multimodal-instruct | 5.63 |
| Phi-4-multimodal-instruct | low | fleurs-ko2en-cot | fleurs-en2ko-cot | phi-4-multimodal-instruct | Lexius | 170 | microsoft/Phi-4-multimodal-instruct | 5.63 |
| Whisper-Large-v3-Turbo-CoreML | medium | `fleurs-en_us` | whisper-large-v3-turbo | aufklarer | 171 | openai/whisper-large-v3-turbo | 5.55 |
| thewhisper-large-v3-turbo | medium | **FLEURS FR** | whisper-large-v3-turbo | TheStageAI | 172 | openai/whisper-large-v3-turbo | 5.18 |
| cohere-transcribe-arabic-07-2026-MLX-Mixed-2bit3bit4bit | medium | FLEURS ar_eg test | cohere-transcribe-arabic-07-2026 | MarkChen1214 | 173 | CohereLabs/cohere-transcribe-arabic-07-2026 | 5.09 |
| thewhisper-large-v3-turbo | medium | **FLEURS PT** | whisper-large-v3-turbo | TheStageAI | 174 | openai/whisper-large-v3-turbo | 4.81 |
| VibeVoice-ASR-BitNet | medium | Fleurs-en | vibevoice-asr-bitnet | microsoft | 175 | microsoft/VibeVoice-ASR-BitNet | 4.73 |
| thewhisper-large-v3-turbo | medium | **FLEURS DE** | whisper-large-v3-turbo | TheStageAI | 176 | openai/whisper-large-v3-turbo | 4.62 |
| tara | medium | [FLEURS-en](https://huggingface.co/datasets/Trelis/fleurs-en-test) | Unknown | Trelis | 177 | — | 4.55 |
| Fun-ASR-MLT-Nano-2512-gguf | medium | Fleurs-zh | Unknown | handy-computer | 178 | FunAudioLLM/Fun-ASR-MLT-Nano-2512 | 3.65 |
| Fun-ASR-Nano-2512-gguf | medium | Fleurs-zh | Unknown | handy-computer | 179 | FunAudioLLM/Fun-ASR-Nano-2512 | 3.65 |
| Fun-ASR-Nano-2512 | medium | Fleurs-zh | Unknown | FunAudioLLM | 180 | FunAudioLLM/Fun-ASR-Nano-2512 | 3.65 |
| Fun-ASR-MLT-Nano-2512 | medium | Fleurs-zh | Unknown | FunAudioLLM | 181 | FunAudioLLM/Fun-ASR-MLT-Nano-2512 | 3.65 |
| thewhisper-large-v3-turbo | medium | **FLEURS ES** | whisper-large-v3-turbo | TheStageAI | 182 | openai/whisper-large-v3-turbo | 3.25 |
| thewhisper-large-v3-turbo | medium | **FLEURS IT** | whisper-large-v3-turbo | TheStageAI | 183 | openai/whisper-large-v3-turbo | 3.21 |
Provenance & metadata (1)
source
- kind
- leaderboard-scrape
- paths
- benchmarks/wer-fleurs.html