Speed sweep

gemma-4-26b-a4b-int8-w8a16-rtx-3090-24gb-vllm-tp2-sweep

gemma-4-26b-a4b-int8-w8a16-rtx-3090-24gb-vllm-tp2-sweep

Record

Recipe
gemma-4-26b-a4b-int8-w8a16-rtx-3090-24gb-vllm-tp2
Measured
2026-07-25
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
1262,1448,865162.946.5historical

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
gemma-4-26b-a4b-int8-w8a16-rtx-3090-24gb-vllm-tp2-sweep
measured at
2026-07-25
recipe id
gemma-4-26b-a4b-int8-w8a16-rtx-3090-24gb-vllm-tp2
schema version
local-ai-registry/v1

metrics

concurrency
1
latest point at
2026-07-25
max context tokens
262,144
peak generation tps
162.9
peak prompt tps
8,865
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
1262,144162.9Unknown40045.48,8651
Provenance & metadata (1)

source