Speed sweep

qwen3-6-27b-fp8-rtx-3090-ti-24gb-vllm-tp2-f8a8wm4k-sweep

qwen3-6-27b-fp8-rtx-3090-ti-24gb-vllm-tp2-f8a8wm4k-sweep

Record

Recipe
qwen3-6-27b-fp8-rtx-3090-ti-24gb-vllm-tp2-f8a8wm4k
Measured
2026-04-27T05:51:03.609Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
1131,07270.3465.4observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
qwen3-6-27b-fp8-rtx-3090-ti-24gb-vllm-tp2-f8a8wm4k-sweep
measured at
2026-04-27T05:51:03.609Z
recipe id
qwen3-6-27b-fp8-rtx-3090-ti-24gb-vllm-tp2-f8a8wm4k
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
0.19.1 + MTP n=3
latest point at
2026-04-27T05:51:03.609Z
max context tokens
131,072
peak generation tps
70.32
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
1131,07270.3270.3251222Unknown1
Provenance & metadata (1)