Speed sweep

pg-01a03076-db78-7579-96b8-dd9c7d13d3ac-sweep

pg-01a03076-db78-7579-96b8-dd9c7d13d3ac-sweep

Record

Recipe
pg-agents-a1-q4km-unknown-apple-m4-max-128gb-llama-cpp-691fd2f14d
Measured
2026-08-23T21:11:30.911Z
Points
3

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
18,25686.3observed
132,83273.341,507.5observed
1262,08017.2observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
pg-01a03076-db78-7579-96b8-dd9c7d13d3ac-sweep
measured at
2026-08-23T21:11:30.911Z
recipe id
pg-agents-a1-q4km-unknown-apple-m4-max-128gb-llama-cpp-691fd2f14d
schema version
local-ai-registry/v1

metrics

base memory bytes
26867122176
base memory context tokens
192
concurrency
1
decode32k context tokens
32,832
decode32k tps
73.306
decode8k context tokens
8,256
decode8k tps
86.296
decode max context tokens
262,080
decode max context tps
17.24
decode mode
non-mtp
inference engine version
1 (32e41fa)
latest point at
2026-08-23T21:11:30.911Z
max context tokens
262,080
max prompt tokens
262,016
memory8k bytes
27380072448
memory8k context tokens
8,256
memory max context bytes
30265212928
memory max context tokens
262,080
peak generation tps
73.306
peak memory bytes
30265212928
peak prompt tps
789.449
point count
224
ttft32k cached prompt tokens
28,668
ttft32k context tokens
32,768
ttft32k seconds
41.507

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
18,25686.296UnknownUnknown25.5Unknown1
132,83273.306UnknownUnknown28.187Unknown1
1262,08017.24UnknownUnknown28.187Unknown1
Provenance & metadata (1)

source

paths
publication:pg-20260827T060320709Z, run:01a03076-db78-7579-96b8-dd9c7d13d3ac
repository
local.ai