Speed sweep

harmonic-hermes-9b-gguf-q6-k-rtx-3060-12gb-llama-cpp-tp1-sweep

harmonic-hermes-9b-gguf-q6-k-rtx-3060-12gb-llama-cpp-tp1-sweep

Record

Recipe
harmonic-hermes-9b-gguf-q6-k-rtx-3060-12gb-llama-cpp-tp1
Measured
2026-07-24T13:51:08.660Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
14,6081,463.639.22,824.1observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
harmonic-hermes-9b-gguf-q6-k-rtx-3060-12gb-llama-cpp-tp1-sweep
measured at
2026-07-24T13:51:08.660Z
recipe id
harmonic-hermes-9b-gguf-q6-k-rtx-3060-12gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
b9775 / be4a6a63e
latest point at
2026-07-24T13:51:08.660Z
max context tokens
4,608
peak generation tps
39.164
peak prompt tps
1,463.597
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
14,60839.16439.1645128.4891,463.5971
Provenance & metadata (1)