Speed sweep

lfm2-5-8b-a1b-q4-k-m-rtx-3080-10gb-llama-cpp-tp1-sweep

lfm2-5-8b-a1b-q4-k-m-rtx-3080-10gb-llama-cpp-tp1-sweep

Record

Recipe
lfm2-5-8b-a1b-q4-k-m-rtx-3080-10gb-llama-cpp-tp1
Measured
2026-08-20T19:46:15.763Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
1128,00010,731.8328.4260.5observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
lfm2-5-8b-a1b-q4-k-m-rtx-3080-10gb-llama-cpp-tp1-sweep
measured at
2026-08-20T19:46:15.763Z
recipe id
lfm2-5-8b-a1b-q4-k-m-rtx-3080-10gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
b10472
latest point at
2026-08-20T19:46:15.763Z
max context tokens
128,000
peak generation tps
328.42
peak prompt tps
10,731.79
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
1128,000328.42328.422566.3910,731.791
Provenance & metadata (1)