Speed sweep

qwen3-6-27b-uncensored-heretic-v2-native-mtp-preserved-q4-k-m-rtx-3090-24gb-vllm-tp1-sweep

qwen3-6-27b-uncensored-heretic-v2-native-mtp-preserved-q4-k-m-rtx-3090-24gb-vllm-tp1-sweep

Record

Recipe
qwen3-6-27b-uncensored-heretic-v2-native-mtp-preserved-q4-k-m-rtx-3090-24gb-vllm-tp1
Measured
2026-07-05
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
2,048159.239.6213.6historical

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
qwen3-6-27b-uncensored-heretic-v2-native-mtp-preserved-q4-k-m-rtx-3090-24gb-vllm-tp1-sweep
measured at
2026-07-05
recipe id
qwen3-6-27b-uncensored-heretic-v2-native-mtp-preserved-q4-k-m-rtx-3090-24gb-vllm-tp1
schema version
local-ai-registry/v1

metrics

inference engine version
0.26.0
latest point at
2026-07-05
max context tokens
2,048
peak generation tps
39.6
peak prompt tps
159.2
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
Unknown2,04839.6Unknown256Unknown159.21
Provenance & metadata (1)