Leaderboard

WER AMI

wer-ami

Record

Category
speech-asr
Scored models
130

Scores

ModelScore
distil-whisper/distil-large-v3100
ibm-granite/granite-3.3-2b-instruct100
ibm-granite/granite-4.0-1b-base100
ibm-granite/granite-4.0-1b-base100
ibm-granite/granite-3.3-8b-instruct100
ibm-granite/granite-speech-4.1-2b100
ibm-granite/granite-3.2-8b-instruct100
ibm-granite/granite-4.0-1b-speech100
distil-whisper/distil-small.en100
—100
distil-whisper/distil-large-v3100
—100
ibm-granite/granite-4.0-1b-speech100
ibm-granite/granite-speech-4.1-2b100
nvidia/Frame_VAD_Multilingual_MarbleNet_v2.096.25
openai/whisper-large-v379
openai/whisper-large-v379
—78
—68.4
—68.4
—68.4
nvidia/multitalker-parakeet-streaming-0.6b-v140
nvidia/multitalker-parakeet-streaming-0.6b-v140
—39.49

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category
speech-asr
id
wer-ami
name
WER AMI
schema version
local-ai-registry/v1

rows

variantconfcontextmodel idorgrankrootscore
distil-large-v3medium[AMI](https://huggingface.co/datasets/edinburghcstr/ami)distil-large-v3distil-whisper1distil-whisper/distil-large-v3100
granite-speech-3.3-2bmediumAMI Englishgranite-3-3-2b-instructibm-granite2ibm-granite/granite-3.3-2b-instruct100
granite-speech-4.1-2bmediumAMI Englishgranite-4-0-1b-baseibm-granite3ibm-granite/granite-4.0-1b-base100
granite-4.0-1b-speechmediumAMI Englishgranite-4-0-1b-baseibm-granite4ibm-granite/granite-4.0-1b-base100
granite-speech-3.3-8bmediumAMI Englishgranite-3-3-8b-instructibm-granite5ibm-granite/granite-3.3-8b-instruct100
granite-speech-4.1-2b-ggufmediumAMI Englishgranite-speech-4-1-2bhandy-computer6ibm-granite/granite-speech-4.1-2b100
granite-speech-3.2-8bmediumAMIgranite-3-2-8b-instructibm-granite7ibm-granite/granite-3.2-8b-instruct100
granite-4.0-1b-speech-ggufmediumAMI Englishgranite-4-0-1b-speechhandy-computer8ibm-granite/granite-4.0-1b-speech100
distil-small.enmedium[AMI](https://huggingface.co/datasets/edinburghcstr/ami)Unknowndistil-whisper9distil-whisper/distil-small.en100
distil-medium.enmedium[AMI](https://huggingface.co/datasets/edinburghcstr/ami)Unknowndistil-whisper10—100
distil-large-v2medium[AMI](https://huggingface.co/datasets/edinburghcstr/ami)distil-large-v3distil-whisper11distil-whisper/distil-large-v3100
Whisper-Medicalv1medium[AMI](https://huggingface.co/datasets/edinburghcstr/ami)UnknownCrystalcareai12—100
granite-4.0-1b-speech-ONNXmediumAMI Englishgranite-4-0-1b-speechonnx-community13ibm-granite/granite-4.0-1b-speech100
granite-speech-4.1-2b-ggufmediumAMI Englishgranite-speech-4-1-2bmemoravox14ibm-granite/granite-speech-4.1-2b100
Frame_VAD_Multilingual_MarbleNet_v2.0mediumAMI-testUnknownnvidia15nvidia/Frame_VAD_Multilingual_MarbleNet_v2.096.25
CrisperWhispermedium[AMI IHM](https://groups.inf.ed.ac.uk/ami/corpus/)whisper-large-v3nyralabs16openai/whisper-large-v379
CrisperWhispermedium[AMI IHM](https://groups.inf.ed.ac.uk/ami/corpus/)whisper-large-v3unsloth17openai/whisper-large-v379
Zipformer-cr-ctc-transducer-XL-290MmediumAMI Meeting CorpusUnknownsoundsgoodai18—78
segmentationmediumAMI Mix-HeadsetUnknownpyannote19—68.4
pyannote-segmentationmediumAMI Mix-HeadsetUnknownphilschmid20—68.4
segmentationmediumAMI Mix-HeadsetUnknowndrewThomasson21—68.4
multitalker-parakeet-streaming-0.6b-v1-ggufmedium**AMI SDM**Unknownhandy-computer22nvidia/multitalker-parakeet-streaming-0.6b-v140
multitalker-parakeet-streaming-0.6b-v1medium**AMI SDM**Unknownnvidia23nvidia/multitalker-parakeet-streaming-0.6b-v140
tironmediumAMI (4 meetings)UnknownTrelis24—39.49
tironmediumAMIUnknownTrelis25—35.24
speaker-diarizationmedium[AMI (*array1, channel 1,*](https://groups.inf.ed.ac.uk/ami/corpus/) [*only_words)*](https://github.com/BUTSpeechFIT/AMI-diarization-setup)Unknownpyannote26—27.12
VibeVoice-ASR-BitNetmediumAMI-sdmvibevoice-asr-bitnetmicrosoft27microsoft/VibeVoice-ASR-BitNet24.18
speaker-diarization-community-1medium[AMI](https://groups.inf.ed.ac.uk/ami/corpus/) (SDM)Unknownpyannote28pyannote/speaker-diarization-community-122.7
speaker-diarization-community-1medium[AMI](https://groups.inf.ed.ac.uk/ami/corpus/) (SDM)Unknownpyannote-community29pyannote/speaker-diarization-community-122.7
speaker-detectionmedium[AMI](https://groups.inf.ed.ac.uk/ami/corpus/) (SDM)UnknownaTrain-core30—22.7
verba-diarization-v1medium[AMI](https://groups.inf.ed.ac.uk/ami/corpus/) (SDM)Unknowniyk8931—22.7
speaker-diarization-3.1medium[AMI (_array1, channel 1,_](https://groups.inf.ed.ac.uk/ami/corpus/) [_only_words)_](https://github.com/BUTSpeechFIT/AMI-diarization-setup)Unknownpyannote32—22.4
speaker-diarization-3.1medium[AMI (_array1, channel 1,_](https://groups.inf.ed.ac.uk/ami/corpus/) [_only_words)_](https://github.com/BUTSpeechFIT/AMI-diarization-setup)Unknownfatymatariq33—22.4
diarizen-wavlm-large-s80-md-v2mediumAMIUnknownBUT-FIT34—22.4
speaker-diarization-3.1medium[AMI (_array1, channel 1,_](https://groups.inf.ed.ac.uk/ami/corpus/) [_only_words)_](https://github.com/BUTSpeechFIT/AMI-diarization-setup)Unknowntensorlake35—22.4
diarizen-wavlm-large-s80-mdmediumAMIUnknownBUT-FIT36—22.4
pyannote-speaker-diarization-31medium[AMI (_array1, channel 1,_](https://groups.inf.ed.ac.uk/ami/corpus/) [_only_words)_](https://github.com/BUTSpeechFIT/AMI-diarization-setup)Unknowncollinbarnwell37—22.4
speaker-diarization-optimizedmedium[AMI (_array1, channel 1,_](https://groups.inf.ed.ac.uk/ami/corpus/) [_only_words)_](https://github.com/BUTSpeechFIT/AMI-diarization-setup)UnknownG-Root38—22.4
diar_streaming_sortformer_4spk-v2.1high**AMI Test IHM**Unknownnvidia39nvidia/diar_streaming_sortformer_4spk-v2.122.39
speaker-diarization-3.0medium[AMI (*array1, channel 1,*](https://groups.inf.ed.ac.uk/ami/corpus/) [*only_words)*](https://github.com/BUTSpeechFIT/AMI-diarization-setup)Unknownpyannote40—22.2
SE-DiCoWmedium**AMI (SDM)**UnknownBUT-FIT41—21.4
DiCoW_v3_3medium**AMI (SDM)**whisper-large-v3-turboBUT-FIT42openai/whisper-large-v3-turbo21.4
multitalker-parakeet-streaming-0.6b-v1-gguflow**AMI IHM**Unknownhandy-computer43nvidia/multitalker-parakeet-streaming-0.6b-v121.26
multitalker-parakeet-streaming-0.6b-v1low**AMI IHM**Unknownnvidia44nvidia/multitalker-parakeet-streaming-0.6b-v121.26
moonshine-streaming-tinymediumAMImoonshine-streaming-tinyUsefulSensors45UsefulSensors/moonshine-streaming-tiny19.03
moonshine-streaming-medium-ggufmediumAMImoonshine-streaming-mediumhandy-computer46UsefulSensors/moonshine-streaming-medium19.03
moonshine-streaming-small-ggufmediumAMImoonshine-streaming-smallhandy-computer47UsefulSensors/moonshine-streaming-small19.03
moonshine-streaming-mediummediumAMImoonshine-streaming-mediumUsefulSensors48UsefulSensors/moonshine-streaming-medium19.03
moonshine-streaming-smallmediumAMImoonshine-streaming-smallUsefulSensors49UsefulSensors/moonshine-streaming-small19.03
moonshine-streaming-tiny-ggufmediumAMImoonshine-streaming-tinyhandy-computer50UsefulSensors/moonshine-streaming-tiny19.03
speaker-diarization-3.0medium[AMI (*headset mix,*](https://groups.inf.ed.ac.uk/ami/corpus/) [*only_words*)](https://github.com/BUTSpeechFIT/AMI-diarization-setup)Unknownpyannote51—19
speaker-diarizationmedium[AMI (*headset mix,*](https://groups.inf.ed.ac.uk/ami/corpus/) [*only_words*)](https://github.com/BUTSpeechFIT/AMI-diarization-setup)Unknownpyannote52—18.91
speaker-diarization-3.1medium[AMI (_headset mix,_](https://groups.inf.ed.ac.uk/ami/corpus/) [_only_words_)](https://github.com/BUTSpeechFIT/AMI-diarization-setup)Unknownpyannote53—18.8
speaker-diarization-community-1medium[AMI](https://groups.inf.ed.ac.uk/ami/corpus/) (IHM)Unknownpyannote54pyannote/speaker-diarization-community-118.8
speaker-diarization-community-1medium[AMI](https://groups.inf.ed.ac.uk/ami/corpus/) (IHM)Unknownpyannote-community55pyannote/speaker-diarization-community-118.8
speaker-diarization-3.1medium[AMI (_headset mix,_](https://groups.inf.ed.ac.uk/ami/corpus/) [_only_words_)](https://github.com/BUTSpeechFIT/AMI-diarization-setup)Unknownfatymatariq56—18.8
speaker-diarization-3.1medium[AMI (_headset mix,_](https://groups.inf.ed.ac.uk/ami/corpus/) [_only_words_)](https://github.com/BUTSpeechFIT/AMI-diarization-setup)Unknowntensorlake57—18.8
speaker-detectionmedium[AMI](https://groups.inf.ed.ac.uk/ami/corpus/) (IHM)UnknownaTrain-core58—18.8
pyannote-speaker-diarization-31medium[AMI (_headset mix,_](https://groups.inf.ed.ac.uk/ami/corpus/) [_only_words_)](https://github.com/BUTSpeechFIT/AMI-diarization-setup)Unknowncollinbarnwell59—18.8
speaker-diarization-optimizedmedium[AMI (_headset mix,_](https://groups.inf.ed.ac.uk/ami/corpus/) [_only_words_)](https://github.com/BUTSpeechFIT/AMI-diarization-setup)UnknownG-Root60—18.8
verba-diarization-v1medium[AMI](https://groups.inf.ed.ac.uk/ami/corpus/) (IHM)Unknowniyk8961—18.8
parakeet-rnnt-0.6blow**AMI**parakeet-rnnt-0-6bnvidia62nvidia/parakeet-rnnt-0.6b17.55
parakeet-rnnt-0.6b-gguflow**AMI**parakeet-rnnt-0-6bhandy-computer63nvidia/parakeet-rnnt-0.6b17.55
parakeet-rnnt-0.6b-gguflow**AMI**parakeet-rnnt-0-6bmemoravox64nvidia/parakeet-rnnt-0.6b17.55
VibeVoice-ASR-BitNetmediumAMI-ihmvibevoice-asr-bitnetmicrosoft65microsoft/VibeVoice-ASR-BitNet17.42
parakeet-rnnt-1.1b-gguflow**AMI**parakeet-rnnt-1-1bhandy-computer66nvidia/parakeet-rnnt-1.1b17.1
parakeet-rnnt-1.1blow**AMI**parakeet-rnnt-1-1bnvidia67nvidia/parakeet-rnnt-1.1b17.1
kotoba-whisper-bilingual-v1.0highESB (AMI) — WERUnknownkotoba-tech68—16.7
parakeet-ctc-0.6b-gguflow**AMI**parakeet-ctc-0-6bhandy-computer69nvidia/parakeet-ctc-0.6b16.3
parakeet-ctc-0.6blow**AMI**parakeet-ctc-0-6bnvidia70nvidia/parakeet-ctc-0.6b16.3
canary-1b-v2-gguflow**AMI**Unknownhandy-computer71nvidia/canary-1b-v216.01
canary-1b-v2low**AMI**Unknownnvidia72nvidia/canary-1b-v216.01
canary-1b-v2-gguflow**AMI**Unknownmemoravox73nvidia/canary-1b-v216.01
diar_streaming_sortformer_4spk-v2.1medium**AMI Test**Unknownnvidia74nvidia/diar_streaming_sortformer_4spk-v2.116
parakeet-tdt_ctc-1.1b-gguflow**AMI**Unknownhandy-computer75nvidia/parakeet-tdt_ctc-1.1b15.94
parakeet-tdt_ctc-1.1blow**AMI**Unknownnvidia76nvidia/parakeet-tdt_ctc-1.1b15.94
parakeet-tdt-1.1b-gguflow**AMI**Unknownhandy-computer77nvidia/parakeet-tdt-1.1b15.9
parakeet-tdt-1.1blow**AMI**Unknownnvidia78nvidia/parakeet-tdt-1.1b15.9
parakeet-tdt_ctc-110m-gguflow**AMI**Unknownhandy-computer79nvidia/parakeet-tdt_ctc-110m15.88
parakeet-tdt_ctc-110mlow**AMI**Unknownnvidia80nvidia/parakeet-tdt_ctc-110m15.88
parakeet-tdt-ctc-110m-coremlmediumAMIUnknownFluidInference81nvidia/parakeet-tdt_ctc-110m15.88
LFM2.5-Audio-1.5BhighOpenlfm2-1-2bLiquidAI82LiquidAI/LFM2-1.2B15.63
LFM2.5-Audio-1.5B-GGUFhighOpenlfm2-1-2bMungert83LiquidAI/LFM2-1.2B15.63
parakeet-ctc-1.1blow**AMI**parakeet-ctc-1-1bnvidia84nvidia/parakeet-ctc-1.1b15.62
parakeet-ctc-1.1b-gguflow**AMI**parakeet-ctc-1-1bhandy-computer85nvidia/parakeet-ctc-1.1b15.62
parakeet_realtime_eou_120m-v1lowAMIUnknownnvidia86nvidia/parakeet_realtime_eou_120m-v115.62
LFM2-Audio-1.5BhighOpenlfm2-1-2bLiquidAI87LiquidAI/LFM2-1.2B15.58
canary-180m-flash-gguflow**AMI**Unknownhandy-computer88nvidia/canary-180m-flash14.86
canary-180m-flashlow**AMI**Unknownnvidia89nvidia/canary-180m-flash14.86
Voxtral-Mini-4B-Realtime-2602lowGigaSpeech 2k Subset | GISpeech 2k Subsetministral-3-3b-base-2512mistralai90mistralai/Ministral-3-3B-Base-251214.43
Voxtral-Mini-4B-Realtime-2602-gguflowGigaSpeech 2k Subset | GISpeech 2k Subsetvoxtral-mini-4b-realtime-2602handy-computer91mistralai/Voxtral-Mini-4B-Realtime-260214.43
Voxtral-Mini-4B-Realtime-2602-ONNXlowGigaSpeech 2k Subset | GISpeech 2k Subsetvoxtral-mini-4b-realtime-2602onnx-community92mistralai/Voxtral-Mini-4B-Realtime-260214.43
Voxtral-Mini-4B-Realtime-2602lowGigaSpeech 2k Subset | GISpeech 2k Subsetministral-3-3b-base-2512suleimanelkhoury93mistralai/Ministral-3-3B-Base-251214.43
Voxtral-Mini-4B-Realtime-2602-GGUFlowGigaSpeech 2k Subset | GISpeech 2k Subsetministral-3-3b-base-2512Bercraft94mistralai/Ministral-3-3B-Base-251214.43
Voxtral-Mini-4B-Realtime-2602-gguflowGigaSpeech 2k Subset | GISpeech 2k Subsetvoxtral-mini-4b-realtime-2602memoravox95mistralai/Voxtral-Mini-4B-Realtime-260214.43
canary-1b-flash-gguflow**AMI**canary-1b-flashhandy-computer96nvidia/canary-1b-flash13.11
canary-1b-flashlow**AMI**canary-1b-flashnvidia97nvidia/canary-1b-flash13.11
canary-1b-flash-gguflow**AMI**canary-1b-flashmemoravox98nvidia/canary-1b-flash13.11
nemotron-speech-streaming-en-0.6blowAMInemotron-speech-streaming-en-0-6bnvidia99nvidia/nemotron-speech-streaming-en-0.6b11.73
nemotron-speech-streaming-en-0.6b-gguflowAMInemotron-speech-streaming-en-0-6bhandy-computer100nvidia/nemotron-speech-streaming-en-0.6b11.73
Nemotron-Speech-Streaming-0.6B-CoreML-INT8mediumAMInemotron-speech-streaming-en-0-6baufklarer101nvidia/nemotron-speech-streaming-en-0.6b11.73
nemotron-speech-streaming-en-0.6b-gguflowAMInemotron-speech-streaming-en-0-6bmemoravox102nvidia/nemotron-speech-streaming-en-0.6b11.73
ARK-ASR-0.6BhighAMIUnknownAudio8103—11.54
parakeet-tdt-0.6b-v3-gguflow**AMI**parakeet-tdt-0-6b-v3handy-computer104nvidia/parakeet-tdt-0.6b-v311.31
parakeet-tdt-0.6b-v3low**AMI**parakeet-tdt-0-6b-v3nvidia105nvidia/parakeet-tdt-0.6b-v311.31
Zipformer-cr-ctc-transducer-XL-290MmediumAMIUnknownsoundsgoodai106—11.3
parakeet-tdt-0.6b-v2high**AMI**Unknownnvidia107nvidia/parakeet-tdt-0.6b-v211.16
parakeet-tdt-0.6b-v2-ggufhigh**AMI**Unknownhandy-computer108nvidia/parakeet-tdt-0.6b-v211.16
Qwen3-ASR-0.6B-hfhighAMIqwen3-asr-0-6b-hfQwen109Qwen/Qwen3-ASR-0.6B-hf10.57
Qwen3-ASR-0.6B-hfhighAMIqwen3-asr-0-6bbezzam110Qwen/Qwen3-ASR-0.6B10.57
canary-qwen-2.5blow**AMI**canary-1b-flashnvidia111nvidia/canary-1b-flash10.18
canary-qwen-2.5b-gguflow**AMI**canary-qwen-2-5bhandy-computer112nvidia/canary-qwen-2.5b10.18
higgs-audio-v3-8b-stt-v2mediumAMIUnknownbosonai113bosonai/higgs-audio-v3-8b10.14
higgs-audio-v3-stt-v2mediumAMIhiggs-audio-v3-sttbosonai114bosonai/higgs-audio-v3-stt10.03
thewhisper-large-v3-turbomedium**AMI**whisper-large-v3-turboTheStageAI115openai/whisper-large-v3-turbo9.6
Qwen3-ASR-1.7B-hfhighAMIqwen3-asr-1-7b-hfQwen116Qwen/Qwen3-ASR-1.7B-hf9.26
Qwen3-ASR-1.7B-hfhighAMIqwen3-asr-1-7bbezzam117Qwen/Qwen3-ASR-1.7B9.26
ARK-ASR-3BhighAMIark-asr-3bAudio8118AutoArk-AI/ARK-ASR-3B8.79
CrisperWhispermedium[AMI](https://huggingface.co/datasets/edinburghcstr/ami)whisper-large-v3nyralabs119openai/whisper-large-v38.72
CrisperWhispermedium[AMI](https://huggingface.co/datasets/edinburghcstr/ami)whisper-large-v3unsloth120openai/whisper-large-v38.72
distil-large-v3.5mediumAMIdistil-large-v3-5distil-whisper121distil-whisper/distil-large-v3.58.68
granite-speech-4.1-2b-plus-gguflow**AMI**granite-speech-4-1-2b-plushandy-computer122ibm-granite/granite-speech-4.1-2b-plus8.63
granite-speech-4.1-2b-plus-gguflow**AMI**granite-speech-4-1-2b-plusmemoravox123ibm-granite/granite-speech-4.1-2b-plus8.63
granite-4.0-1b-speechhigh**AMI**granite-4-0-1b-baseibm-granite124ibm-granite/granite-4.0-1b-base8.44
granite-4.0-1b-speech-gguflow**AMI**granite-4-0-1b-speechhandy-computer125ibm-granite/granite-4.0-1b-speech8.44
granite-4.0-1b-speech-ONNXlow**AMI**granite-4-0-1b-speechonnx-community126ibm-granite/granite-4.0-1b-speech8.44
MOSS-Transcribe-preview-2BmediumAMImoss-transcribe-preview-2bOpenMOSS-Team127OpenMOSS-Team/MOSS-Transcribe-preview-2B8.37
granite-speech-4.1-2b-plushigh**AMI**granite-4-0-1b-baseibm-granite128ibm-granite/granite-4.0-1b-base8.09
higgs-audio-v3-8b-sttmediumAMIUnknownbosonai129bosonai/higgs-audio-v3-8b6.23
speakerverification_en_titanet_largelowAMI (Lapel)Unknownnvidia130nvidia/speakerverification_en_titanet_large2.03
Provenance & metadata (1)

source

kind
leaderboard-scrape
paths
benchmarks/wer-ami.html, docs/notes/hf-benchmark-contexts.json