Speed sweep

seed-oss-36b-instruct-q4-k-m-rtx-3060-12gb-llama-cpp-tp2-sweep

seed-oss-36b-instruct-q4-k-m-rtx-3060-12gb-llama-cpp-tp2-sweep

Record

Recipe
seed-oss-36b-instruct-q4-k-m-rtx-3060-12gb-llama-cpp-tp2
Measured
2026-07-13T20:31:10.641Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
1512453.514.71,230.8observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
seed-oss-36b-instruct-q4-k-m-rtx-3060-12gb-llama-cpp-tp2-sweep
measured at
2026-07-13T20:31:10.641Z
recipe id
seed-oss-36b-instruct-q4-k-m-rtx-3060-12gb-llama-cpp-tp2
schema version
local-ai-registry/v1

metrics

concurrency
1
latest point at
2026-07-13T20:31:10.641Z
max context tokens
512
peak generation tps
14.69
peak prompt tps
453.52
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
151214.69Unknown12822.9453.521
Provenance & metadata (1)