Speed sweep

qwen3-6-27b-awq-int4-rtx-3060-12gb-vllm-tp2-68h7yf95-sweep

qwen3-6-27b-awq-int4-rtx-3060-12gb-vllm-tp2-68h7yf95-sweep

Record

Recipe
qwen3-6-27b-awq-int4-rtx-3060-12gb-vllm-tp2-68h7yf95
Measured
2026-07-06T03:13:02.944Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
4,1041,119.86.83,665observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
qwen3-6-27b-awq-int4-rtx-3060-12gb-vllm-tp2-68h7yf95-sweep
measured at
2026-07-06T03:13:02.944Z
recipe id
qwen3-6-27b-awq-int4-rtx-3060-12gb-vllm-tp2-68h7yf95
schema version
local-ai-registry/v1

metrics

inference engine version
0.26.0
latest point at
2026-07-06T03:13:02.944Z
max context tokens
4,104
peak generation tps
6.8
peak prompt tps
1,119.8
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
Unknown4,1046.8Unknown3221.81,119.81
Provenance & metadata (1)