COLLECTION / COMPARE
56 devices · 23 measuredCompare hardware
Every accelerator side by side: memory, vendor-published throughput, the lowest live US listing, and how many launch recipes the registry holds. Click a column to rank by it; * marks structured-sparsity figures where the vendor publishes no dense number.
Published specifications
Vendor-published compute figures. Missing precision columns remain blank instead of being estimated from a different datatype or sparse mode.
| Hardware | VRAM | Bandwidth | FP16 TFLOPS | FP8 TFLOPS | FP4 TFLOPS | INT8 TOPS | Lowest new (US) | ▾ Recipes |
|---|---|---|---|---|---|---|---|---|
| Apple M5 Max 128GB | 128 GB | 460–614 GB/s | — | — | — | — | $4,099 | 155 |
| Apple M3 Ultra 96GB 80-core GPU | 96 GB | 819 GB/s | — | — | — | — | $6,199 | 144 |
| Apple M3 Ultra 96GB 60-core GPU | 96 GB | 819 GB/s | — | — | — | — | $6,199 | 121 |
| Apple M4 Pro 48GB | 48 GB | 273 GB/s | — | — | — | — | — | 119 |
| Apple M5 Pro 64GB | 64 GB | 307 GB/s | — | — | — | — | $2,499 | 110 |
| Apple M4 Max 128GB | 128 GB | 410–546 GB/s | — | — | — | — | $1,999 | 103 |
| Apple M4 Max 36GB | 36 GB | 410–546 GB/s | — | — | — | — | $1,999 | 84 |
| Apple M3 Ultra 512GB | 512 GB | 819 GB/s | — | — | — | — | $6,199 | 27 |
| Apple M1 Max 64GB | 64 GB | 400 GB/s | — | — | — | — | — | 24 |
| Apple M5 Pro 24GB | 24 GB | 307 GB/s | — | — | — | — | $2,499 | 21 |
| Apple Max 128GB, generation unspecified | 128 GB | — | — | — | — | — | — | 10 |
| Apple M4 16GB | 16 GB | 120 GB/s | — | — | — | — | $799 | 3 |
| Apple M1 Pro 32GB | 32 GB | 200 GB/s | — | — | — | — | — | 2 |
| Apple M3 24GB | 24 GB | 100 GB/s | — | — | — | — | — | 2 |
| Apple M4 Max 64GB | 64 GB | 410–546 GB/s | — | — | — | — | $1,999 | 2 |
| Apple M4 Pro 24GB | 24 GB | 273 GB/s | — | — | — | — | — | 2 |
| Apple M5 Pro 48GB | 48 GB | 307 GB/s | — | — | — | — | $2,499 | 2 |
| Apple M2 Pro 16GB | 16 GB | 200 GB/s | — | — | — | — | — | 1 |
| Apple M3 Max 128GB | 128 GB | 300–400 GB/s | — | — | — | — | $6,499 | 1 |
| Apple M3 Ultra 96GB | 96 GB | 819 GB/s | — | — | — | — | $6,199 | 1 |
| Apple M4 Max 48GB | 48 GB | 410–546 GB/s | — | — | — | — | $1,999 | 1 |
| Apple M5 32GB | 32 GB | 153 GB/s | — | — | — | — | $1,999 | 1 |
| Apple Pro 64GB, generation unspecified | 64 GB | — | — | — | — | — | — | 1 |
| Apple M1 16GB | 16 GB | 68.25 GB/s | — | — | — | — | — | 0 |
| Apple M1 8GB | 8 GB | 68.25 GB/s | — | — | — | — | — | 0 |
| Apple M1 Max 32GB | 32 GB | 400 GB/s | — | — | — | — | — | 0 |
| Apple M1 Pro 16GB | 16 GB | 200 GB/s | — | — | — | — | — | 0 |
| Apple M1 Ultra 128GB | 128 GB | 800 GB/s | — | — | — | — | — | 0 |
| Apple M1 Ultra 64GB | 64 GB | 800 GB/s | — | — | — | — | — | 0 |
| Apple M2 16GB | 16 GB | 100 GB/s | — | — | — | — | — | 0 |
| Apple M2 24GB | 24 GB | 100 GB/s | — | — | — | — | — | 0 |
| Apple M2 8GB | 8 GB | 100 GB/s | — | — | — | — | — | 0 |
| Apple M2 Max 32GB | 32 GB | 400 GB/s | — | — | — | — | — | 0 |
| Apple M2 Max 64GB | 64 GB | 400 GB/s | — | — | — | — | — | 0 |
| Apple M2 Max 96GB | 96 GB | 400 GB/s | — | — | — | — | — | 0 |
| Apple M2 Pro 32GB | 32 GB | 200 GB/s | — | — | — | — | — | 0 |
| Apple M2 Ultra 128GB | 128 GB | 800 GB/s | — | — | — | — | — | 0 |
| Apple M2 Ultra 192GB | 192 GB | 800 GB/s | — | — | — | — | — | 0 |
| Apple M2 Ultra 64GB | 64 GB | 800 GB/s | — | — | — | — | — | 0 |
| Apple M3 16GB | 16 GB | 100 GB/s | — | — | — | — | — | 0 |
| Apple M3 8GB | 8 GB | 100 GB/s | — | — | — | — | — | 0 |
| Apple M3 Max 36GB | 36 GB | 300–400 GB/s | — | — | — | — | $6,499 | 0 |
| Apple M3 Max 48GB | 48 GB | 300–400 GB/s | — | — | — | — | $6,499 | 0 |
| Apple M3 Max 64GB | 64 GB | 300–400 GB/s | — | — | — | — | $6,499 | 0 |
| Apple M3 Max 96GB | 96 GB | 300–400 GB/s | — | — | — | — | $6,499 | 0 |
| Apple M3 Pro 18GB | 18 GB | 150 GB/s | — | — | — | — | — | 0 |
| Apple M3 Pro 36GB | 36 GB | 150 GB/s | — | — | — | — | — | 0 |
| Apple M3 Ultra 256GB | 256 GB | 819 GB/s | — | — | — | — | $6,199 | 0 |
| Apple M4 24GB | 24 GB | 120 GB/s | — | — | — | — | $799 | 0 |
| Apple M4 32GB | 32 GB | 120 GB/s | — | — | — | — | $799 | 0 |
| Apple M4 Pro 64GB | 64 GB | 273 GB/s | — | — | — | — | — | 0 |
| Apple M5 16GB | 16 GB | 153 GB/s | — | — | — | — | $1,999 | 0 |
| Apple M5 24GB | 24 GB | 153 GB/s | — | — | — | — | $1,999 | 0 |
| Apple M5 Max 36GB | 36 GB | 460–614 GB/s | — | — | — | — | $4,099 | 0 |
| Apple M5 Max 48GB | 48 GB | 460–614 GB/s | — | — | — | — | $4,099 | 0 |
| Apple M5 Max 64GB | 64 GB | 460–614 GB/s | — | — | — | — | $4,099 | 0 |
Measured local inference
Best observed values across the registry's cited speed sweeps. The Model variants column counts distinct model-instance records. Model, quantization, engine, context, and concurrency differ between runs; use these as an evidence index, not an equal-workload ranking.
| Hardware | Sweeps | Points | Model variants | Peak prefill | Peak decode | Best TTFT | Max observed context | Peak observed VRAM |
|---|---|---|---|---|---|---|---|---|
| Apple M3 Ultra 96GB 80-core GPU | 241 | 964 | 144 | — | 210.7 tok/s | 5,606.2 ms | 262,080 tokens | 151.6 GB |
| Apple M5 Max 128GB | 254 | 929 | 155 | 67,121.5 tok/s | 484.5 tok/s | 8.3 ms | 262,144 tokens | 124.5 GB |
| Apple M3 Ultra 96GB 60-core GPU | 211 | 843 | 121 | — | 201.8 tok/s | 3,063.7 ms | 262,080 tokens | 437 GB |
| Apple M4 Pro 48GB | 202 | 758 | 117 | 1,092.6 tok/s | 144.5 tok/s | 497 ms | 262,144 tokens | 437 GB |
| Apple M4 Max 128GB | 180 | 719 | 103 | — | 221.6 tok/s | 2,760.1 ms | 262,080 tokens | 109.7 GB |
| Apple M5 Pro 64GB | 176 | 665 | 106 | — | 174.7 tok/s | 221.7 ms | 262,080 tokens | 437 GB |
| Apple M4 Max 36GB | 134 | 536 | 84 | — | 188.6 tok/s | 9,263.3 ms | 262,080 tokens | 122.5 GB |
| Apple M3 Ultra 512GB | 27 | 27 | 27 | 2,247.2 tok/s | 213 tok/s | 23.9 ms | 40,960,000 tokens | 336.1 GB |
| Apple M1 Max 64GB | 24 | 24 | 22 | 6,011.9 tok/s | 83.6 tok/s | 23.8 ms | 2,048 tokens | — |
| Apple M5 Pro 24GB | 21 | 21 | 21 | 5,820.1 tok/s | 267.8 tok/s | 49.2 ms | 8,192 tokens | — |
| Apple Max 128GB, generation unspecified | 10 | 10 | 10 | 1,100 tok/s | 135 tok/s | 250 ms | 131,072 tokens | 60.3 GB |
| Apple M3 24GB | 2 | 8 | 2 | — | 7.4 tok/s | 1,708,332 ms | 147,392 tokens | 17.7 GB |
| Apple M3 Max 128GB | 1 | 4 | 1 | — | 17 tok/s | 211,570 ms | 262,080 tokens | 37.4 GB |
| Apple M4 16GB | 3 | 3 | 3 | 36.9 tok/s | 21.6 tok/s | 1,287.9 ms | 4,096 tokens | 9.9 GB |
| Apple M1 Pro 32GB | 2 | 2 | 2 | 334.9 tok/s | 32.2 tok/s | 95.5 ms | 262,144 tokens | 26 GB |
| Apple M4 Max 64GB | 2 | 2 | 2 | — | 83.4 tok/s | 105.8 ms | 262,144 tokens | 25.9 GB |
| Apple M4 Pro 24GB | 2 | 2 | 2 | 2,385.5 tok/s | 61 tok/s | — | 2,048 tokens | 1.4 GB |
| Apple M5 Pro 48GB | 2 | 2 | 2 | 250.7 tok/s | 189.3 tok/s | 133.6 ms | 2,048 tokens | 34.2 GB |
| Apple M2 Pro 16GB | 1 | 1 | 1 | — | 33 tok/s | 1,400 ms | 4,096 tokens | — |
| Apple M3 Ultra 96GB | 1 | 1 | 1 | — | 38.3 tok/s | — | 262,144 tokens | — |
| Apple M4 Max 48GB | 1 | 1 | 1 | — | 21.8 tok/s | 0.8 ms | 4,096 tokens | — |
| Apple M5 32GB | 1 | 1 | 1 | 103.5 tok/s | 34.3 tok/s | — | 64,000 tokens | — |
| Apple Pro 64GB, generation unspecified | 1 | 1 | 1 | — | 105 tok/s | 109.3 ms | 2,048 tokens | 3 GB |