Speed sweep

gemma-4-12b-coder-fable5-composer2-5-v1-gguf-nvfp4-rtx-5090-32gb-vllm-tp1-sweep

gemma-4-12b-coder-fable5-composer2-5-v1-gguf-nvfp4-rtx-5090-32gb-vllm-tp1-sweep

Record

Recipe
gemma-4-12b-coder-fable5-composer2-5-v1-gguf-nvfp4-rtx-5090-32gb-vllm-tp1
Measured
2026-07-23
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
2,0481,067.618331.9historical

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
gemma-4-12b-coder-fable5-composer2-5-v1-gguf-nvfp4-rtx-5090-32gb-vllm-tp1-sweep
measured at
2026-07-23
recipe id
gemma-4-12b-coder-fable5-composer2-5-v1-gguf-nvfp4-rtx-5090-32gb-vllm-tp1
schema version
local-ai-registry/v1

metrics

inference engine version
0.26.0
latest point at
2026-07-23
max context tokens
2,048
peak generation tps
183
peak prompt tps
1,067.6
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
Unknown2,048183Unknown256Unknown1,067.61
Provenance & metadata (1)