Speed sweep

lfm2-5-8b-a1b-q6-k-rtx-3060-12gb-llama-cpp-tp2-sweep

lfm2-5-8b-a1b-q6-k-rtx-3060-12gb-llama-cpp-tp2-sweep

Record

Recipe
lfm2-5-8b-a1b-q6-k-rtx-3060-12gb-llama-cpp-tp2
Measured
2026-05-28T22:03:11.207Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
1128,0002,731.9175.6observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
lfm2-5-8b-a1b-q6-k-rtx-3060-12gb-llama-cpp-tp2-sweep
measured at
2026-05-28T22:03:11.207Z
recipe id
lfm2-5-8b-a1b-q6-k-rtx-3060-12gb-llama-cpp-tp2
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
2cbfdc6
latest point at
2026-05-28T22:03:11.207Z
max context tokens
128,000
peak generation tps
175.6
peak prompt tps
2,731.9
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
1128,000175.6175.62568.22,731.91
Provenance & metadata (1)