Local AI Registry

Speed sweep

pg-01a028b6-7c91-7711-a55b-57efc1080fc4-sweep

pg-01a028b6-7c91-7711-a55b-57efc1080fc4-sweep
JSON APIBack to speed sweep search

Record

Recipe
pg-qwen3-5-9b-q4km-unknown-apple-m4-pro-48gb-llama-cpp-be2726a8ac
Measured
2026-08-22T09:04:03.189Z
Points
3

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
18,256—35.6—observed
132,832—28.9121,679observed
1262,080—7.4—observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
pg-01a028b6-7c91-7711-a55b-57efc1080fc4-sweep
measured at
2026-08-22T09:04:03.189Z
recipe id
pg-qwen3-5-9b-q4km-unknown-apple-m4-pro-48gb-llama-cpp-be2726a8ac
schema version
local-ai-registry/v1

metrics

base memory bytes
14570176512
base memory context tokens
192
concurrency
1
decode32k context tokens
32,832
decode32k tps
28.945
decode8k context tokens
8,256
decode8k tps
35.563
decode max context tokens
262,080
decode max context tps
7.424
decode mode
non-mtp
inference engine version
unknown
latest point at
2026-08-22T09:04:03.189Z
max context tokens
262,080
max prompt tokens
262,016
memory8k bytes
15005073408
memory8k context tokens
8,256
memory max context bytes
17578164224
memory max context tokens
262,080
peak generation tps
28.945
peak memory bytes
17578164224
peak prompt tps
269.299
point count
224
ttft32k cached prompt tokens
28,668
ttft32k context tokens
32,768
ttft32k seconds
121.679

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
18,25635.563UnknownUnknown13.975Unknown1
132,83228.945UnknownUnknown16.371Unknown1
1262,0807.424UnknownUnknown16.371Unknown1
Provenance & metadata (1)

source

paths
publication:pg-20260827T060320709Z, run:01a028b6-7c91-7711-a55b-57efc1080fc4
repository
local.ai ↗