Speed sweep

gemma-4-31b-ud-q4-k-xl-qat-rtx-5090-32gb-llama-cpp-tp1-sweep

gemma-4-31b-ud-q4-k-xl-qat-rtx-5090-32gb-llama-cpp-tp1-sweep

Record

Recipe
gemma-4-31b-ud-q4-k-xl-qat-rtx-5090-32gb-llama-cpp-tp1
Measured
2026-06-14T16:20:58.421Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
18,192710.668.5115.4observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
gemma-4-31b-ud-q4-k-xl-qat-rtx-5090-32gb-llama-cpp-tp1-sweep
measured at
2026-06-14T16:20:58.421Z
recipe id
gemma-4-31b-ud-q4-k-xl-qat-rtx-5090-32gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
b741 (1fd6dfe)
latest point at
2026-06-14T16:20:58.421Z
max context tokens
8,192
peak generation tps
68.5
peak prompt tps
710.6
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
18,19268.568.551217.8710.61
Provenance & metadata (1)