Local AI Registry

Speed sweep

pg-01a02811-1500-7e40-a9b6-0c2ed3e1a9d5-sweep

pg-01a02811-1500-7e40-a9b6-0c2ed3e1a9d5-sweep
JSON APIBack to speed sweep search

Record

Recipe
pg-nex-n2-mini-q4km-unknown-apple-m4-pro-48gb-llama-cpp-44f2b86dec
Measured
2026-08-22T06:03:23.249Z
Points
3

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
18,256—51.3—observed
132,832—4291,170.4observed
1262,080—7.4—observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
pg-01a02811-1500-7e40-a9b6-0c2ed3e1a9d5-sweep
measured at
2026-08-22T06:03:23.249Z
recipe id
pg-nex-n2-mini-q4km-unknown-apple-m4-pro-48gb-llama-cpp-44f2b86dec
schema version
local-ai-registry/v1

metrics

base memory bytes
27108212736
base memory context tokens
192
concurrency
1
decode32k context tokens
32,832
decode32k tps
41.957
decode8k context tokens
8,256
decode8k tps
51.341
decode max context tokens
262,080
decode max context tps
7.399
decode mode
non-mtp
inference engine version
unknown
latest point at
2026-08-22T06:03:23.249Z
max context tokens
262,080
max prompt tokens
262,016
memory8k bytes
27620507648
memory8k context tokens
8,256
memory max context bytes
30483628032
memory max context tokens
262,080
peak generation tps
41.957
peak memory bytes
30483628032
peak prompt tps
359.415
point count
224
ttft32k cached prompt tokens
28,668
ttft32k context tokens
32,768
ttft32k seconds
91.17

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
18,25651.341UnknownUnknown25.724Unknown1
132,83241.957UnknownUnknown28.39Unknown1
1262,0807.399UnknownUnknown28.39Unknown1
Provenance & metadata (1)

source

paths
publication:pg-20260827T060320709Z, run:01a02811-1500-7e40-a9b6-0c2ed3e1a9d5
repository
local.ai ↗