Speed sweep

gemma-4-12b-it-q4-k-m-rtx-4070-12gb-vllm-tp1-sweep

gemma-4-12b-it-q4-k-m-rtx-4070-12gb-vllm-tp1-sweep

Record

Recipe
gemma-4-12b-it-q4-k-m-rtx-4070-12gb-vllm-tp1
Measured
2026-07-20
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
12,048240.748.9153.7historical

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
gemma-4-12b-it-q4-k-m-rtx-4070-12gb-vllm-tp1-sweep
measured at
2026-07-20
recipe id
gemma-4-12b-it-q4-k-m-rtx-4070-12gb-vllm-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
latest point at
2026-07-20
max context tokens
2,048
peak generation tps
48.9
peak prompt tps
240.7
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
12,04848.9Unknown256Unknown240.71
Provenance & metadata (1)

source