Local AI Registry

Speed sweep

pg-01a02b83-9304-7cb7-ba8e-c765d02b6071-sweep

pg-01a02b83-9304-7cb7-ba8e-c765d02b6071-sweep
JSON APIBack to speed sweep search

Record

Recipe
pg-gemma-4-31b-q4km-unknown-apple-m4-max-36gb-llama-cpp-bd7c2060ae
Measured
2026-08-22T22:07:18.263Z
Points
3

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
18,256—16.8—observed
132,832—14.6284,854.7observed
173,664—11.6—observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
pg-01a02b83-9304-7cb7-ba8e-c765d02b6071-sweep
measured at
2026-08-22T22:07:18.263Z
recipe id
pg-gemma-4-31b-q4km-unknown-apple-m4-max-36gb-llama-cpp-bd7c2060ae
schema version
local-ai-registry/v1

metrics

base memory bytes
26349240320
base memory context tokens
192
concurrency
1
decode32k context tokens
32,832
decode32k tps
14.591
decode8k context tokens
8,256
decode8k tps
16.802
decode max context tokens
73,664
decode max context tps
11.61
decode mode
non-mtp
inference engine version
unknown
latest point at
2026-08-22T22:07:18.263Z
max context tokens
73,664
max prompt tokens
73,600
memory8k bytes
28796125184
memory8k context tokens
8,256
memory max context bytes
28236546048
memory max context tokens
73,664
peak generation tps
13.37
peak memory bytes
29748838400
peak prompt tps
99.213
point count
63
ttft32k cached prompt tokens
28,735
ttft32k context tokens
32,768
ttft32k seconds
284.855

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
18,25616.802UnknownUnknown26.818Unknown1
132,83214.591UnknownUnknown27.706Unknown1
173,66411.61UnknownUnknown26.297Unknown1
Provenance & metadata (1)

source

paths
publication:pg-20260827T060320709Z, run:01a02b83-9304-7cb7-ba8e-c765d02b6071
repository
local.ai ↗