Speed sweep

gemma-4-31b-it-ud-q6-k-xl-rtx-3090-24gb-llama-cpp-tp2-sweep

gemma-4-31b-it-ud-q6-k-xl-rtx-3090-24gb-llama-cpp-tp2-sweep

Record

Recipe
gemma-4-31b-it-ud-q6-k-xl-rtx-3090-24gb-llama-cpp-tp2
Measured
2026-04-26T06:55:09.606Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
132,76814.42,263.4observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
gemma-4-31b-it-ud-q6-k-xl-rtx-3090-24gb-llama-cpp-tp2-sweep
measured at
2026-04-26T06:55:09.606Z
recipe id
gemma-4-31b-it-ud-q6-k-xl-rtx-3090-24gb-llama-cpp-tp2
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
b8870
latest point at
2026-04-26T06:55:09.606Z
max context tokens
32,768
peak generation tps
14.38
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
132,76814.3814.3851220.7Unknown1
Provenance & metadata (1)