Local AI Registry

Speed sweep

pg-01a026ab-6605-7a99-b005-b6a353d701d9-sweep

pg-01a026ab-6605-7a99-b005-b6a353d701d9-sweep
JSON APIBack to speed sweep search

Record

Recipe
pg-gemma-4-31b-q4km-unknown-apple-m4-max-36gb-llama-cpp-bd7c2060ae
Measured
2026-08-21T23:32:42.098Z
Points
3

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
18,256—17—observed
132,832—14.7282,086.3observed
165,728—12.4—observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
pg-01a026ab-6605-7a99-b005-b6a353d701d9-sweep
measured at
2026-08-21T23:32:42.098Z
recipe id
pg-gemma-4-31b-q4km-unknown-apple-m4-max-36gb-llama-cpp-bd7c2060ae
schema version
local-ai-registry/v1

metrics

base memory bytes
18742113280
base memory context tokens
192
concurrency
1
decode32k context tokens
32,832
decode32k tps
14.671
decode8k context tokens
8,256
decode8k tps
16.975
decode max context tokens
65,728
decode max context tps
12.364
decode mode
non-mtp
inference engine version
unknown
latest point at
2026-08-21T23:32:42.098Z
max context tokens
65,728
max prompt tokens
65,664
memory8k bytes
32614773760
memory8k context tokens
8,256
memory max context bytes
131485004800
memory max context tokens
65,728
peak generation tps
13.437
peak memory bytes
131485004800
peak prompt tps
99.719
point count
57
ttft32k cached prompt tokens
28,735
ttft32k context tokens
32,768
ttft32k seconds
282.086

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
18,25616.975UnknownUnknown30.375Unknown1
132,83214.671UnknownUnknown122.455Unknown1
165,72812.364UnknownUnknown122.455Unknown1
Provenance & metadata (1)

source

paths
publication:pg-20260827T060320709Z, run:01a026ab-6605-7a99-b005-b6a353d701d9
repository
local.ai ↗