Local AI Registry

Speed sweep

pg-01a03610-d41a-7aac-bb79-9418c3117e84-sweep

pg-01a03610-d41a-7aac-bb79-9418c3117e84-sweep
JSON APIBack to speed sweep search

Record

Recipe
pg-gemma-4-12b-q4km-unknown-apple-m5-max-128gb-llama-cpp-8c3280ed2c
Measured
2026-08-24T23:17:47.663Z
Points
3

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
18,256—53.6—observed
132,832—4547,105.2observed
1262,080—18.1—observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
pg-01a03610-d41a-7aac-bb79-9418c3117e84-sweep
measured at
2026-08-24T23:17:47.663Z
recipe id
pg-gemma-4-12b-q4km-unknown-apple-m5-max-128gb-llama-cpp-8c3280ed2c
schema version
local-ai-registry/v1

metrics

base memory bytes
12320243712
base memory context tokens
192
concurrency
1
decode32k context tokens
32,832
decode32k tps
45.04
decode8k context tokens
8,256
decode8k tps
53.64
decode max context tokens
262,080
decode max context tps
18.084
decode mode
non-mtp
inference engine version
unknown
latest point at
2026-08-24T23:17:47.663Z
max context tokens
262,080
max prompt tokens
262,016
memory8k bytes
14571208704
memory8k context tokens
8,256
memory max context bytes
24395628544
memory max context tokens
262,080
peak generation tps
45.04
peak memory bytes
24457936896
peak prompt tps
695.634
point count
224
ttft32k cached prompt tokens
28,672
ttft32k context tokens
32,768
ttft32k seconds
47.105

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
18,25653.64UnknownUnknown13.57Unknown1
132,83245.04UnknownUnknown22.778Unknown1
1262,08018.084UnknownUnknown22.72Unknown1
Provenance & metadata (1)

source

paths
publication:pg-20260827T060320709Z, run:01a03610-d41a-7aac-bb79-9418c3117e84
repository
local.ai ↗