Speed sweep

gemma-4-12b-it-qat-q4-0-unquantized-q4-0-rtx-3060-ti-8gb-llama-cpp-tp1-sweep

gemma-4-12b-it-qat-q4-0-unquantized-q4-0-rtx-3060-ti-8gb-llama-cpp-tp1-sweep

Record

Recipe
gemma-4-12b-it-qat-q4-0-unquantized-q4-0-rtx-3060-ti-8gb-llama-cpp-tp1
Measured
2026-06-15T19:44:53.788Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
20482,04835.117.4observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
gemma-4-12b-it-qat-q4-0-unquantized-q4-0-rtx-3060-ti-8gb-llama-cpp-tp1-sweep
measured at
2026-06-15T19:44:53.788Z
recipe id
gemma-4-12b-it-qat-q4-0-unquantized-q4-0-rtx-3060-ti-8gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
2,048
latest point at
2026-06-15T19:44:53.788Z
max context tokens
2,048
peak generation tps
17.38
peak prompt tps
35.1
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
2,0482,04817.38Unknown128Unknown35.11
Provenance & metadata (1)