Speed sweep

qwen3-5-9b-q4-k-m-rtx-3060-12gb-llama-cpp-tp1-bah9z5zv-sweep

qwen3-5-9b-q4-k-m-rtx-3060-12gb-llama-cpp-tp1-bah9z5zv-sweep

Record

Recipe
qwen3-5-9b-q4-k-m-rtx-3060-12gb-llama-cpp-tp1-bah9z5zv
Measured
2026-08-18T16:37:58.222Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
132,7681,457.951.9observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
qwen3-5-9b-q4-k-m-rtx-3060-12gb-llama-cpp-tp1-bah9z5zv-sweep
measured at
2026-08-18T16:37:58.222Z
recipe id
qwen3-5-9b-q4-k-m-rtx-3060-12gb-llama-cpp-tp1-bah9z5zv
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
b10443
latest point at
2026-08-18T16:37:58.222Z
max context tokens
32,768
peak generation tps
51.89
peak prompt tps
1,457.92
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
132,76851.8951.892,2725.711,457.921
Provenance & metadata (1)