Speed sweep

pg-019f2c34-db4e-76df-be7c-8f0e80dfa846-sweep

pg-019f2c34-db4e-76df-be7c-8f0e80dfa846-sweep

JSON API Back to speed sweep search

Record

Recipe: pg-unsloth-qwen3-6-27b-ud-mlx-4bit-4bit-apple-m4-pro-48gb-mlx-8a444b2d04
Measured: 2026-07-04T08:18:09.352Z
Points: 4

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status
1	8,256	—	9.1	—	observed
1	32,832	—	8.4	—	observed
1	122,944	—	—	—	observed
1	32,768	—	—	324,614.7	observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id: pg-019f2c34-db4e-76df-be7c-8f0e80dfa846-sweep
measured at: 2026-07-04T08:18:09.352Z
recipe id: pg-unsloth-qwen3-6-27b-ud-mlx-4bit-4bit-apple-m4-pro-48gb-mlx-8a444b2d04
schema version: local-ai-registry/v1

metrics

base memory bytes: 25904373859
base memory context tokens: 192
concurrency: 1
decode32k context tokens: 32,832
decode32k tps: 8.375
decode8k context tokens: 8,256
decode8k tps: 9.114
decode max context tokens: 122,944
decode mode: non-mtp
inference engine version: 0.31.3
latest point at: 2026-07-04T08:18:09.352Z
max context tokens: 122,944
max prompt tokens: 122,880
memory8k bytes: 29601359110
memory8k context tokens: 8,256
memory max context bytes: 66435432448
memory max context tokens: 122,944
peak generation tps: 8.375
peak memory bytes: 66435432448
peak prompt tps: 100.944
point count: 105
ttft32k cached prompt tokens: 28,736
ttft32k context tokens: 32,768
ttft32k seconds: 324.615

rows

concurrency	context tokens	decode tok s	decode tok s per stream	output tokens	peak vram gb	prefill tok s	samples
1	8,256	9.114	9.114	Unknown	27.568	Unknown	1
1	32,832	8.375	8.375	Unknown	61.873	Unknown	1
1	122,944	Unknown	Unknown	Unknown	61.873	Unknown	1
1	32,768	Unknown	Unknown	Unknown	Unknown	Unknown	1

Provenance & metadata (1)

source

paths: publication:pg-20260827T060320709Z, run:019f2c34-db4e-76df-be7c-8f0e80dfa846
repository: local.ai ↗