Local AI Registry

Speed sweep

pg-01a02bba-ac9c-7c2f-ab17-8fdff4a13604-sweep

pg-01a02bba-ac9c-7c2f-ab17-8fdff4a13604-sweep
JSON APIBack to speed sweep search

Record

Recipe
pg-qwen3-5-9b-q4km-unknown-apple-m4-max-36gb-llama-cpp-81afae4d23
Measured
2026-08-22T23:07:29.292Z
Points
3

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
18,256—51.9—observed
132,832—45.263,492.7observed
1262,080—12—observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
pg-01a02bba-ac9c-7c2f-ab17-8fdff4a13604-sweep
measured at
2026-08-22T23:07:29.292Z
recipe id
pg-qwen3-5-9b-q4km-unknown-apple-m4-max-36gb-llama-cpp-81afae4d23
schema version
local-ai-registry/v1

metrics

base memory bytes
14567669760
base memory context tokens
192
concurrency
1
decode32k context tokens
32,832
decode32k tps
45.16
decode8k context tokens
8,256
decode8k tps
51.893
decode max context tokens
262,080
decode max context tps
12.032
decode mode
non-mtp
inference engine version
unknown
latest point at
2026-08-22T23:07:29.292Z
max context tokens
262,080
max prompt tokens
262,016
memory8k bytes
15002779648
memory8k context tokens
8,256
memory max context bytes
17578868736
memory max context tokens
262,080
peak generation tps
45.16
peak memory bytes
17578868736
peak prompt tps
516.091
point count
224
ttft32k cached prompt tokens
28,668
ttft32k context tokens
32,768
ttft32k seconds
63.493

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
18,25651.893UnknownUnknown13.972Unknown1
132,83245.16UnknownUnknown16.372Unknown1
1262,08012.032UnknownUnknown16.372Unknown1
Provenance & metadata (1)

source

paths
publication:pg-20260827T060320709Z, run:01a02bba-ac9c-7c2f-ab17-8fdff4a13604
repository
local.ai ↗