Recipe
laguna-s-2-1-4bit-affine-gs64-apple-m5-max-128gb-mlx-tp1
laguna-s-2-1-4bit-affine-gs64-apple-m5-max-128gb-mlx-tp1Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.
Record
- Status
- candidate
- Source
- localmaxxing
- Engine
- mlx
- Engine version
- mlx 0.32.0 + mlx-lm 0.31.3 + zmlx 0.9.0
- Accelerators
- 1
- Tensor parallel
- 1
- Context tokens
- 376
- chat
- unknown
- reasoning
- unknown
- tools
- unknown
- vision
- unknown
Hugging Face model card
Identity
https://huggingface.co/pipenetwork/Laguna-S-2.1-MLX-4bit- Repository
- pipenetwork/Laguna-S-2.1-MLX-4bit
- Status
- known
- Link type
- Exact Hub repository
Public Hugging Face repository confirmed by the Hub API.
Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.
Observed configuration
mlx
Evidence only · candidate · reference
Candidate evidence — not a Run contract
Observed source tokens
Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.
pythonbench_speed.py(one-big-function@mx.compile+zmlxmoe_mlpsigmoidgatingfix+precomputedmasks+bf16gating)
Measured speed
| Concurrency | Context | Prefill | Decode | TTFT ms | Status | Sweep |
|---|---|---|---|---|---|---|
| — | 376 | 139.2 | 69.5 | 1,710.3 | observed | laguna-s-2-1-4bit-affine-gs64-apple-m5-max-128gb-mlx-tp1-sweep |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- hardware count
- 1
- hardware id
- apple-m5-max-128gb
- id
- laguna-s-2-1-4bit-affine-gs64-apple-m5-max-128gb-mlx-tp1
- model instance id
- pipenetwork-laguna-s-2-1-mlx-4bit--4bit-affine-gs64
- recipe source
- localmaxxing
- schema version
- local-ai-registry/v1
- speed sweep ids
- laguna-s-2-1-4bit-affine-gs64-apple-m5-max-128gb-mlx-tp1-sweep
- status
- candidate
capabilities
engine
- name
- mlx
- version
- mlx 0.32.0 + mlx-lm 0.31.3 + zmlx 0.9.0
serving
- max context tokens
- 376
- tensor parallel
- 1
Provenance & metadata (3)
facts
- capabilities.chat · provenance · captured at
- 2026-08-30T09:10:02Z
capabilities.chat · reason capability-not-verified
capabilities.chat · state unknown
- capabilities.reasoning · provenance · captured at
- 2026-08-30T09:10:02Z
capabilities.reasoning · reason capability-not-verified
capabilities.reasoning · state unknown
- capabilities.tools · provenance · captured at
- 2026-08-30T09:10:02Z
capabilities.tools · reason capability-not-verified
capabilities.tools · state unknown
- capabilities.vision · provenance · captured at
- 2026-08-30T09:10:02Z
capabilities.vision · reason capability-not-verified
capabilities.vision · state unknown
- engine.graph mode · provenance · captured at
- 2026-08-30T09:10:02Z
engine.graph mode · reason runtime-detail-not-published
engine.graph mode · state unknown
- serving.kv cache tokens · provenance · captured at
- 2026-08-30T09:10:02Z
serving.kv cache tokens · reason kv-cache-capacity-not-published
serving.kv cache tokens · state unknown
- serving.max concurrency · provenance · captured at
- 2026-08-31T23:03:15Z
serving.max concurrency · reason server-capacity-not-evidenced
serving.max concurrency · state unknown
metadata
- localmaxxing · backend
- metal
- localmaxxing · batch size
- 1
- localmaxxing · hardware label
- M5 Max
- localmaxxing · notes
- Optimized MLX decode: one-big-function @mx.compile (48 layers), zmlx moe_mlp patch with sigmoid gating fix (zmlx defaults to softmax, Laguna uses sigmoid), precomputed attention masks, bfloat16 gating. Pure MLX, no torch/CUDA. Quality: 0.9555 Pearson logit correlation vs BF16 reference. Code: github.com/jacklarmer/laguna-apple
- localmaxxing · observed command
- python bench_speed.py (one-big-function @mx.compile + zmlx moe_mlp sigmoid gating fix + precomputed masks + bf16 gating)
- localmaxxing · run id
- cms3c730w00w6s201nzhq8cmh
- localmaxxing · tokenized · arguments
- python, bench_speed.py, (one-big-function, @mx.compile, +, zmlx, moe_mlp, sigmoid, gating, fix, +, precomputed, masks, +, bf16, gating)
- localmaxxing · tokenized · fidelity
- faithful
provenance
- captured at
- 2026-08-30T09:10:02Z
sources
| captured at | kind | url |
|---|---|---|
| 2026-08-30T09:10:02Z | normalized-recipe | www.localmaxxing.com/en/runs/cms3c730w00w6s201nzhq8cmh ↗ |