Local AI Registry

Speed sweep

pg-01a034c6-394a-701a-a0c0-8ff932b7a7a1-sweep

pg-01a034c6-394a-701a-a0c0-8ff932b7a7a1-sweep
JSON APIBack to speed sweep search

Record

Recipe
pg-lfm2-5-8b-a1b-q8-unknown-apple-m5-max-128gb-llama-cpp-76a14171e0
Measured
2026-08-24T17:16:41.141Z
Points
3

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
18,256—203.6—observed
132,832—181.29,225.2observed
1127,936—124.5—observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
pg-01a034c6-394a-701a-a0c0-8ff932b7a7a1-sweep
measured at
2026-08-24T17:16:41.141Z
recipe id
pg-lfm2-5-8b-a1b-q8-unknown-apple-m5-max-128gb-llama-cpp-76a14171e0
schema version
local-ai-registry/v1

metrics

base memory bytes
10728865792
base memory context tokens
192
concurrency
1
decode32k context tokens
32,832
decode32k tps
181.153
decode8k context tokens
8,256
decode8k tps
203.551
decode max context tokens
127,936
decode max context tps
124.508
decode mode
non-mtp
inference engine version
unknown
latest point at
2026-08-24T17:16:41.141Z
max context tokens
127,936
max prompt tokens
127,872
memory8k bytes
10779131904
memory8k context tokens
8,256
memory max context bytes
11293573120
memory max context tokens
127,936
peak generation tps
181.153
peak memory bytes
11293573120
peak prompt tps
3,551.995
point count
112
ttft32k cached prompt tokens
28,668
ttft32k context tokens
32,768
ttft32k seconds
9.225

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
18,256203.551UnknownUnknown10.039Unknown1
132,832181.153UnknownUnknown10.518Unknown1
1127,936124.508UnknownUnknown10.518Unknown1
Provenance & metadata (1)

source

paths
publication:pg-20260827T060320709Z, run:01a034c6-394a-701a-a0c0-8ff932b7a7a1
repository
local.ai ↗