Speed sweep

qwen3-5-9b-awq-int4-rtx-3060-12gb-vllm-tp2-sweep

qwen3-5-9b-awq-int4-rtx-3060-12gb-vllm-tp2-sweep

Record

Recipe
qwen3-5-9b-awq-int4-rtx-3060-12gb-vllm-tp2
Measured
2026-07-05
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
15122,122.784.3225.2historical

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
qwen3-5-9b-awq-int4-rtx-3060-12gb-vllm-tp2-sweep
measured at
2026-07-05
recipe id
qwen3-5-9b-awq-int4-rtx-3060-12gb-vllm-tp2
schema version
local-ai-registry/v1

metrics

concurrency
1
latest point at
2026-07-05
max context tokens
512
peak generation tps
84.3
peak prompt tps
2,122.7
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
151284.3Unknown12819.62,122.71
Provenance & metadata (1)

source