Leaderboard
tau-bench
tau-benchRecord
- Category
- agentic
- Scored models
- 40
Scores
| Model | Score |
|---|---|
| zai-org/GLM-4-32B-0414 | 68.7 |
| THUDM/GLM-4-32B-0414 | 68.7 |
| zai-org/GLM-4-9B-0414 | 58.3 |
| THUDM/GLM-4-9B-0414 | 58.3 |
| zai-org/GLM-4-32B-Base-0414 | 58.3 |
| THUDM/GLM-4-9B-0414 | 58.3 |
| THUDM/GLM-4-9B-0414 | 58.3 |
| THUDM/GLM-4-9B-0414 | 58.3 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 56.9 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 56.9 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 56.9 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 56.9 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | 56.9 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 56.9 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 56.9 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 56.9 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 49 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 49 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 49 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 49 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | 49 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 49 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 49 |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 49 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- category
- agentic
- id
- tau-bench
- name
- tau-bench
- schema version
- local-ai-registry/v1
rows
| variant | conf | context | model id | org | rank | root | score |
|---|---|---|---|---|---|---|---|
| GLM-4-32B-0414 | high | Unknown | glm-4-32b-0414 | zai-org | 1 | zai-org/GLM-4-32B-0414 | 68.7 |
| GLM-4-32B-0414-GGUF | high | Unknown | Unknown | unsloth | 2 | THUDM/GLM-4-32B-0414 | 68.7 |
| GLM-4-9B-0414 | low | Unknown | glm-4-9b-0414 | zai-org | 3 | zai-org/GLM-4-9B-0414 | 58.3 |
| GLM-4-9B-0414-GGUF | low | Unknown | glm-4-9b-0414 | unsloth | 4 | THUDM/GLM-4-9B-0414 | 58.3 |
| GLM-4-32B-Base-0414 | low | Unknown | glm-4-32b-base-0414 | zai-org | 5 | zai-org/GLM-4-32B-Base-0414 | 58.3 |
| GLM-4-9B-0414-unsloth-bnb-4bit | low | Unknown | glm-4-9b-0414 | unsloth | 6 | THUDM/GLM-4-9B-0414 | 58.3 |
| GLM-4-9B-0414 | low | Unknown | glm-4-9b-0414 | unsloth | 7 | THUDM/GLM-4-9B-0414 | 58.3 |
| GLM-4-9B-0414-bnb-4bit | low | Unknown | glm-4-9b-0414 | unsloth | 8 | THUDM/GLM-4-9B-0414 | 58.3 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | medium | TauBench V2 (Retail) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 9 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 56.9 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | medium | TauBench V2 (Retail) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 10 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 56.9 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 | medium | TauBench V2 (Retail) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 11 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 56.9 |
| Nemotron-3-Nano-30B-A3B-GGUF | medium | TauBench V2 (Retail) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 12 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 56.9 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | medium | TauBench V2 (Retail) | nvidia-nemotron-3-nano-30b-a3b-nvfp4 | unsloth | 13 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | 56.9 |
| Nemotron-3-Nano-30B-A3B | medium | TauBench V2 (Retail) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 14 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 56.9 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF | medium | TauBench V2 (Retail) | nvidia-nemotron-3-nano-30b-a3b-bf16 | Mungert | 15 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 56.9 |
| Nemotron-3-Nano-30B-A3B-FP8 | medium | TauBench V2 (Retail) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 16 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 56.9 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | medium | TauBench V2 (Average) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 17 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 49 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | medium | TauBench V2 (Average) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 18 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 49 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 | medium | TauBench V2 (Average) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 19 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 49 |
| Nemotron-3-Nano-30B-A3B-GGUF | medium | TauBench V2 (Average) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 20 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 49 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | medium | TauBench V2 (Average) | nvidia-nemotron-3-nano-30b-a3b-nvfp4 | unsloth | 21 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | 49 |
| Nemotron-3-Nano-30B-A3B | medium | TauBench V2 (Average) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 22 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 49 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF | medium | TauBench V2 (Average) | nvidia-nemotron-3-nano-30b-a3b-bf16 | Mungert | 23 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 49 |
| Nemotron-3-Nano-30B-A3B-FP8 | medium | TauBench V2 (Average) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 24 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 49 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | medium | TauBench V2 (Airline) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 25 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 48 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | medium | TauBench V2 (Airline) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 26 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 48 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 | medium | TauBench V2 (Airline) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 27 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 48 |
| Nemotron-3-Nano-30B-A3B-GGUF | medium | TauBench V2 (Airline) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 28 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 48 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | medium | TauBench V2 (Airline) | nvidia-nemotron-3-nano-30b-a3b-nvfp4 | unsloth | 29 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | 48 |
| Nemotron-3-Nano-30B-A3B | medium | TauBench V2 (Airline) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 30 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 48 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF | medium | TauBench V2 (Airline) | nvidia-nemotron-3-nano-30b-a3b-bf16 | Mungert | 31 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 48 |
| Nemotron-3-Nano-30B-A3B-FP8 | medium | TauBench V2 (Airline) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 32 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 48 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | medium | TauBench V2 (Telecom) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 33 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 42.2 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | medium | TauBench V2 (Telecom) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 34 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 42.2 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 | medium | TauBench V2 (Telecom) | nvidia-nemotron-3-nano-30b-a3b-bf16 | nvidia | 35 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 42.2 |
| Nemotron-3-Nano-30B-A3B-GGUF | medium | TauBench V2 (Telecom) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 36 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 42.2 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | medium | TauBench V2 (Telecom) | nvidia-nemotron-3-nano-30b-a3b-nvfp4 | unsloth | 37 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 | 42.2 |
| Nemotron-3-Nano-30B-A3B | medium | TauBench V2 (Telecom) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 38 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 42.2 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF | medium | TauBench V2 (Telecom) | nvidia-nemotron-3-nano-30b-a3b-bf16 | Mungert | 39 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 42.2 |
| Nemotron-3-Nano-30B-A3B-FP8 | medium | TauBench V2 (Telecom) | nvidia-nemotron-3-nano-30b-a3b-bf16 | unsloth | 40 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 42.2 |
Provenance & metadata (1)
source
- kind
- leaderboard-scrape
- paths
- benchmarks/tau-bench.html