Speed sweep

qwen3-8-27b-w4a16-autoround-rtx-3090-24gb-sglang-tp2-y0tyt5cf-sweep

qwen3-8-27b-w4a16-autoround-rtx-3090-24gb-sglang-tp2-y0tyt5cf-sweep

Record

Recipe
qwen3-8-27b-w4a16-autoround-rtx-3090-24gb-sglang-tp2-y0tyt5cf
Measured
2026-08-26T23:05:10.172Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
2,0481,638.5192.6676.8observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
qwen3-8-27b-w4a16-autoround-rtx-3090-24gb-sglang-tp2-y0tyt5cf-sweep
measured at
2026-08-26T23:05:10.172Z
recipe id
qwen3-8-27b-w4a16-autoround-rtx-3090-24gb-sglang-tp2-y0tyt5cf
schema version
local-ai-registry/v1

metrics

inference engine version
0.0.0.dev1+geec794bce
latest point at
2026-08-26T23:05:10.172Z
max context tokens
2,048
peak generation tps
192.6
peak prompt tps
1,638.5
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
Unknown2,048192.6Unknown512Unknown1,638.51
Provenance & metadata (1)