Speed sweep

qwen3-5-9b-base-q8-0-rtx-3080-ti-12gb-llama-cpp-tp1-sweep

qwen3-5-9b-base-q8-0-rtx-3080-ti-12gb-llama-cpp-tp1-sweep

Record

Recipe
qwen3-5-9b-base-q8-0-rtx-3080-ti-12gb-llama-cpp-tp1
Measured
2026-05-02T04:29:24.426Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
1250,00015.4164,149.5observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
qwen3-5-9b-base-q8-0-rtx-3080-ti-12gb-llama-cpp-tp1-sweep
measured at
2026-05-02T04:29:24.426Z
recipe id
qwen3-5-9b-base-q8-0-rtx-3080-ti-12gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
latest point at
2026-05-02T04:29:24.426Z
max context tokens
250,000
peak generation tps
15.36
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
1250,00015.36Unknown0UnknownUnknown1
Provenance & metadata (1)