Leaderboard

Codex-Eval

codex-eval

Record

Category: coding
Scored models: 27

Scores

Model	Score
allenai/tulu-65b	28.9
allenai/tulu-30b	25.4
—	25.4
allenai/tulu-30b	25.4
allenai/tulu-30b	25.4
allenai/open-instruct-human-mix-65b	24.5
allenai/open-instruct-human-mix-65b	24.5
allenai/tulu-13b	21.3
—	21.3
allenai/tulu-7b	17.5
allenai/tulu-7b	17.5
—	17.5
allenai/open-instruct-code-alpaca-7b	16.5
allenai/open-instruct-pythia-6.9b-tulu	14.3
allenai/open-instruct-stanford-alpaca-7b	13.2
allenai/open-instruct-gpt4-alpaca-7b	13.2
allenai/open-instruct-baize-7b	12.2
allenai/open-instruct-cot-13b	11.5
allenai/open-instruct-dolly-7b	11.1
allenai/open-instruct-sharegpt-7b	10.9
allenai/open-instruct-unnatural-instructions-7b	10.3
allenai/open-instruct-oasst1-7b	10.1
allenai/open-instruct-flan-v2-7b	9.6
allenai/open-instruct-human-mix-7b	9.4

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

category: coding
id: codex-eval
name: Codex-Eval
schema version: local-ai-registry/v1

rows

variant	conf	context	model id	org	rank	root	score
tulu-65b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	1	allenai/tulu-65b	28.9
tulu-30B-GGUF	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	TheBloke	2	allenai/tulu-30b	25.4
tulu-30B-fp16	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	TheBloke	3	—	25.4
tulu-30b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	4	allenai/tulu-30b	25.4
tulu-30B-GPTQ	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	TheBloke	5	allenai/tulu-30b	25.4
open-instruct-human-mix-65B-GGUF	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	TheBloke	6	allenai/open-instruct-human-mix-65b	24.5
open-instruct-human-mix-65b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	7	allenai/open-instruct-human-mix-65b	24.5
tulu-13B-GGUF	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	TheBloke	8	allenai/tulu-13b	21.3
tulu-13B-fp16	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	TheBloke	9	—	21.3
tulu-7B-GGUF	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	TheBloke	10	allenai/tulu-7b	17.5
tulu-7b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	11	allenai/tulu-7b	17.5
tulu-7B-fp16	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	TheBloke	12	—	17.5
open-instruct-code-alpaca-7b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	13	allenai/open-instruct-code-alpaca-7b	16.5
open-instruct-pythia-6.9b-tulu	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	14	allenai/open-instruct-pythia-6.9b-tulu	14.3
open-instruct-stanford-alpaca-7b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	15	allenai/open-instruct-stanford-alpaca-7b	13.2
open-instruct-gpt4-alpaca-7b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	16	allenai/open-instruct-gpt4-alpaca-7b	13.2
open-instruct-baize-7b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	17	allenai/open-instruct-baize-7b	12.2
open-instruct-cot-13b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	18	allenai/open-instruct-cot-13b	11.5
open-instruct-dolly-7b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	19	allenai/open-instruct-dolly-7b	11.1
open-instruct-sharegpt-7b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	20	allenai/open-instruct-sharegpt-7b	10.9
open-instruct-unnatural-instructions-7b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	21	allenai/open-instruct-unnatural-instructions-7b	10.3
open-instruct-oasst1-7b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	22	allenai/open-instruct-oasst1-7b	10.1
open-instruct-flan-v2-7b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	23	allenai/open-instruct-flan-v2-7b	9.6
open-instruct-human-mix-7b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	24	allenai/open-instruct-human-mix-7b	9.4
open-instruct-cot-7b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	25	allenai/open-instruct-cot-7b	7.4
open-instruct-sni-7b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	26	allenai/open-instruct-sni-7b	7
open-instruct-self-instruct-7b	low	GSM CoT \| BBH CoT \| TydiQA Closed-book	Unknown	allenai	27	allenai/open-instruct-self-instruct-7b	6.2

Provenance & metadata (1)

source

kind: leaderboard-scrape
paths: benchmarks/codex-eval.html
url: huggingface.co/spaces/codex-eval ↗