Speed sweep

step-3-7-flash-q4-k-s-rtx-3090-24gb-llama-cpp-tp8-sweep

step-3-7-flash-q4-k-s-rtx-3090-24gb-llama-cpp-tp8-sweep

Record

Recipe
step-3-7-flash-q4-k-s-rtx-3090-24gb-llama-cpp-tp8
Measured
2026-06-03T09:00:04.066Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
1262,14452.7198.7observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
step-3-7-flash-q4-k-s-rtx-3090-24gb-llama-cpp-tp8-sweep
measured at
2026-06-03T09:00:04.066Z
recipe id
step-3-7-flash-q4-k-s-rtx-3090-24gb-llama-cpp-tp8
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
StepFun step3.7 branch 8112410
latest point at
2026-06-03T09:00:04.066Z
max context tokens
262,144
peak generation tps
52.7
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
1262,14452.752.71,000UnknownUnknown1
Provenance & metadata (1)