Speed sweep

deepseek-r1-distill-qwen-7b-q4-k-m-rtx-3060-12gb-llama-cpp-tp1-sweep

deepseek-r1-distill-qwen-7b-q4-k-m-rtx-3060-12gb-llama-cpp-tp1-sweep

Record

Recipe
deepseek-r1-distill-qwen-7b-q4-k-m-rtx-3060-12gb-llama-cpp-tp1
Measured
2026-07-23T16:41:07.885Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
15122,304.168325.3observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
deepseek-r1-distill-qwen-7b-q4-k-m-rtx-3060-12gb-llama-cpp-tp1-sweep
measured at
2026-07-23T16:41:07.885Z
recipe id
deepseek-r1-distill-qwen-7b-q4-k-m-rtx-3060-12gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
13f2b28
latest point at
2026-07-23T16:41:07.885Z
max context tokens
512
peak generation tps
67.96
peak prompt tps
2,304.05
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
151267.9667.96128Unknown2,304.051
Provenance & metadata (1)