Speed sweep

qwen2-5-coder-7b-q4-k-m-rtx-3080-12gb-llama-cpp-tp1-sweep

qwen2-5-coder-7b-q4-k-m-rtx-3080-12gb-llama-cpp-tp1-sweep

Record

Recipe
qwen2-5-coder-7b-q4-k-m-rtx-3080-12gb-llama-cpp-tp1
Measured
2026-05-13T16:25:15.176Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
12,0485,183.9140.8observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
qwen2-5-coder-7b-q4-k-m-rtx-3080-12gb-llama-cpp-tp1-sweep
measured at
2026-05-13T16:25:15.176Z
recipe id
qwen2-5-coder-7b-q4-k-m-rtx-3080-12gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
latest point at
2026-05-13T16:25:15.176Z
max context tokens
2,048
peak generation tps
140.75
peak prompt tps
5,183.94
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
12,048140.75Unknown0Unknown5,183.941
Provenance & metadata (1)