Speed sweep

qwen3-8-27b-q6-k-xl-rtx-5090-32gb-llama-cpp-tp1-sweep

qwen3-8-27b-q6-k-xl-rtx-5090-32gb-llama-cpp-tp1-sweep

Record

Recipe
qwen3-8-27b-q6-k-xl-rtx-5090-32gb-llama-cpp-tp1
Measured
2026-08-18T04:22:36.152Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
1131,0002,032.193.6279.2observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
qwen3-8-27b-q6-k-xl-rtx-5090-32gb-llama-cpp-tp1-sweep
measured at
2026-08-18T04:22:36.152Z
recipe id
qwen3-8-27b-q6-k-xl-rtx-5090-32gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
10437, commit 16d222fc5
latest point at
2026-08-18T04:22:36.152Z
max context tokens
131,000
peak generation tps
93.55
peak prompt tps
2,032.1
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
1131,00093.5593.5551230.532,032.11
Provenance & metadata (1)