Speed sweep

huihui-qwen3-8-27b-abliterated-mlx-8bit-apple-m3-ultra-96gb-mlx-tp1-sweep

huihui-qwen3-8-27b-abliterated-mlx-8bit-apple-m3-ultra-96gb-mlx-tp1-sweep

Record

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status
—	262,144	—	38.3	—	historical

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id: huihui-qwen3-8-27b-abliterated-mlx-8bit-apple-m3-ultra-96gb-mlx-tp1-sweep
measured at: 2026-08-19
recipe id: huihui-qwen3-8-27b-abliterated-mlx-8bit-apple-m3-ultra-96gb-mlx-tp1
schema version: local-ai-registry/v1

metrics

inference engine version: oMLX 0.6.1 (12249931772fe070fb957a85a65c8f87ea4363b8)
latest point at: 2026-08-19
max context tokens: 262,144
peak generation tps: 38.3
point count: 1

rows

concurrency	context tokens	decode tok s	decode tok s per stream	output tokens	peak vram gb	prefill tok s	samples
Unknown	262,144	38.3	Unknown	210	Unknown	Unknown	1

Provenance & metadata (1)

source