COLLECTION / BENCHMARK

Leaderboards

Scraped public quality scores from GitHub Pages leaderboards such as Terminal-Bench 2.1. These are not local speed measurements.

10 records
AlpacaEvalalpacaevalchatcategory136scored models97.7top scorechat
ChartQAchartqamultimodalcategory200scored models89.7top scoremultimodal
DocVQAdocvqamultimodalcategory218scored models96.4top scoremultimodal
MathVistamathvistamultimodalcategory96scored models80.1top scoremultimodal
MMBenchmmbenchmultimodalcategory85scored models88.2top scoremultimodal
MMMUmmmumultimodalcategory324scored models82top scoremultimodal
OpenBookQAopenbookqaknowledgecategory81scored models89.8top scoreknowledge
WER LibriSpeechwer-librispeechspeech-asrcategory73scored models100top scorespeech-asr
WER VoxPopuliwer-voxpopulispeech-asrcategory96scored models24.9top scorespeech-asr