Local AI Registry

Speed sweep

pg-01a03076-ec6b-7e9c-8dc3-bf370357e536-sweep

pg-01a03076-ec6b-7e9c-8dc3-bf370357e536-sweep
JSON APIBack to speed sweep search

Record

Recipe
pg-gemma-4-e4b-q8kxl-unknown-apple-m4-max-36gb-llama-cpp-a60f823adc
Measured
2026-08-23T21:11:35.260Z
Points
3

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
18,256—50.4—observed
132,832—45.741,815.7observed
1131,008—32.6—observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
pg-01a03076-ec6b-7e9c-8dc3-bf370357e536-sweep
measured at
2026-08-23T21:11:35.260Z
recipe id
pg-gemma-4-e4b-q8kxl-unknown-apple-m4-max-36gb-llama-cpp-a60f823adc
schema version
local-ai-registry/v1

metrics

base memory bytes
11122229248
base memory context tokens
192
concurrency
1
decode32k context tokens
32,832
decode32k tps
45.719
decode8k context tokens
8,256
decode8k tps
50.438
decode max context tokens
131,008
decode max context tps
32.573
decode mode
non-mtp
inference engine version
unknown
latest point at
2026-08-23T21:11:35.260Z
max context tokens
131,008
max prompt tokens
130,944
memory8k bytes
11407572992
memory8k context tokens
8,256
memory max context bytes
12488753152
memory max context tokens
131,008
peak generation tps
42.641
peak memory bytes
12488753152
peak prompt tps
645.693
point count
112
ttft32k cached prompt tokens
28,677
ttft32k context tokens
32,768
ttft32k seconds
41.816

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
18,25650.438UnknownUnknown10.624Unknown1
132,83245.719UnknownUnknown11.631Unknown1
1131,00832.573UnknownUnknown11.631Unknown1
Provenance & metadata (1)

source

paths
publication:pg-20260827T060320709Z, run:01a03076-ec6b-7e9c-8dc3-bf370357e536
repository
local.ai ↗