Speed sweep

glm-5-2-mxfp8-nvfp4-nf3-hybrid-mxfp8-nvfp4-nf3-hybrid-rtx-pro-6000-blackwell-96gb-vllm-tp4-sweep

glm-5-2-mxfp8-nvfp4-nf3-hybrid-mxfp8-nvfp4-nf3-hybrid-rtx-pro-6000-blackwell-96gb-vllm-tp4-sweep

Record

Recipe
glm-5-2-mxfp8-nvfp4-nf3-hybrid-mxfp8-nvfp4-nf3-hybrid-rtx-pro-6000-blackwell-96gb-vllm-tp4
Measured
2026-07-31
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
1480,00092355.1historical

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
glm-5-2-mxfp8-nvfp4-nf3-hybrid-mxfp8-nvfp4-nf3-hybrid-rtx-pro-6000-blackwell-96gb-vllm-tp4-sweep
measured at
2026-07-31
recipe id
glm-5-2-mxfp8-nvfp4-nf3-hybrid-mxfp8-nvfp4-nf3-hybrid-rtx-pro-6000-blackwell-96gb-vllm-tp4
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
0.11.2.dev279+eldritch.enlightenment.v56a5c3e.kingdom.plus5.71fca68.b12x7bfc945.fi25dd814.cu132.20260706
latest point at
2026-07-31
max context tokens
480,000
peak generation tps
91.969
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
1480,00091.96991.969512UnknownUnknown1
Provenance & metadata (1)