Speed sweep

pg-019f2c34-cf6a-71bd-b64b-2cbaee25b791-sweep

pg-019f2c34-cf6a-71bd-b64b-2cbaee25b791-sweep

Record

Recipe
pg-liquidai-lfm2-5-8b-a1b-mlx-4bit-4bit-apple-m3-ultra-96gb-60c-mlx-f2ced56107
Measured
2026-07-04T08:18:06.309Z
Points
3

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
18,256171.5observed
132,832138.110,347observed
1123,96878.5observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
pg-019f2c34-cf6a-71bd-b64b-2cbaee25b791-sweep
measured at
2026-07-04T08:18:06.309Z
recipe id
pg-liquidai-lfm2-5-8b-a1b-mlx-4bit-4bit-apple-m3-ultra-96gb-60c-mlx-f2ced56107
schema version
local-ai-registry/v1

metrics

base memory bytes
5050671572
base memory context tokens
192
concurrency
1
decode32k context tokens
32,832
decode32k tps
138.062
decode8k context tokens
8,256
decode8k tps
171.483
decode max context tokens
123,968
decode max context tps
78.534
decode mode
non-mtp
inference engine version
0.31.3
latest point at
2026-07-04T08:18:06.309Z
max context tokens
123,968
max prompt tokens
123,904
memory8k bytes
5941366304
memory8k context tokens
8,256
memory max context bytes
9088667228
memory max context tokens
123,968
peak generation tps
138.062
peak memory bytes
9088667228
peak prompt tps
3,166.923
point count
109
ttft32k cached prompt tokens
28,736
ttft32k context tokens
32,768
ttft32k seconds
10.347

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
18,256171.483UnknownUnknown5.533Unknown1
132,832138.062UnknownUnknown8.464Unknown1
1123,96878.534UnknownUnknown8.464Unknown1
Provenance & metadata (1)

source

paths
publication:pg-20260827T060320709Z, run:019f2c34-cf6a-71bd-b64b-2cbaee25b791
repository
local.ai