Speed sweep

qwen3-8-27b-q8-k-xl-rtx-pro-6000-blackwell-96gb-llama-cpp-tp1-sweep

qwen3-8-27b-q8-k-xl-rtx-pro-6000-blackwell-96gb-llama-cpp-tp1-sweep

Record

Recipe
qwen3-8-27b-q8-k-xl-rtx-pro-6000-blackwell-96gb-llama-cpp-tp1
Measured
2026-08-20T19:38:56.046Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
199,1002,311.488.142,652.1observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
qwen3-8-27b-q8-k-xl-rtx-pro-6000-blackwell-96gb-llama-cpp-tp1-sweep
measured at
2026-08-20T19:38:56.046Z
recipe id
qwen3-8-27b-q8-k-xl-rtx-pro-6000-blackwell-96gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
0.1.2-dev build 10498
latest point at
2026-08-20T19:38:56.046Z
max context tokens
99,100
peak generation tps
88.063
peak prompt tps
2,311.447
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
199,10088.06388.063512Unknown2,311.4471
Provenance & metadata (1)