COLLECTION / COMPARE
100 devices · 66 measuredCompare hardware
Every accelerator side by side: memory, vendor-published throughput, the lowest live US listing, and how many launch recipes the registry holds. Click a column to rank by it; * marks structured-sparsity figures where the vendor publishes no dense number.
Published specifications
Vendor-published compute figures. Missing precision columns remain blank instead of being estimated from a different datatype or sparse mode.
| Hardware | VRAM | Bandwidth | FP16 TFLOPS | FP8 TFLOPS | FP4 TFLOPS | INT8 TOPS | Lowest new (US) | ▾ Recipes |
|---|---|---|---|---|---|---|---|---|
| GeForce RTX 3060 | 12 GB | 360 GB/s | — | — | — | — | $500 | 178 |
| GeForce RTX 3090 | 24 GB | 936 GB/s | 142 | — | — | 284 | — | 159 |
| RTX PRO 6000 Blackwell | 96 GB | 1,792 GB/s | 503.8 | 1,007.6 | 2,015.2 | 1,007.6 | $14,400 | 158 |
| Apple M5 Max 128GB | 128 GB | 460–614 GB/s | — | — | — | — | $4,099 | 155 |
| Apple M3 Ultra 96GB 80-core GPU | 96 GB | 819 GB/s | — | — | — | — | $6,199 | 144 |
| Intel Arc Pro B70 | 32 GB | 608 GB/s | — | — | — | 367 | $1,700 | 141 |
| GeForce RTX 5090 | 32 GB | 1,792 GB/s | 419 | 838 | 1,676 | 838 | $2,500 | 140 |
| Apple M3 Ultra 96GB 60-core GPU | 96 GB | 819 GB/s | — | — | — | — | $6,199 | 121 |
| Apple M4 Pro 48GB | 48 GB | 273 GB/s | — | — | — | — | — | 119 |
| Apple M5 Pro 64GB | 64 GB | 307 GB/s | — | — | — | — | $2,499 | 110 |
| Ryzen AI Max+ 395 | 128 GB | 256 GB/s | 60 | — | — | — | $2,599 | 104 |
| Apple M4 Max 128GB | 128 GB | 410–546 GB/s | — | — | — | — | $1,999 | 103 |
| Radeon AI PRO R9700 | 32 GB | 640 GB/s | 191 | 383 | — | 383 | $1,300 | 101 |
| Apple M4 Max 36GB | 36 GB | 410–546 GB/s | — | — | — | — | $1,999 | 84 |
| NVIDIA DGX Spark GB10 | 128 GB | 273 GB/s | — | — | 1,000 * | — | $4,700 | 82 |
| Radeon RX 7900 XTX | 24 GB | 960 GB/s | 123 | — | — | 123 | — | 42 |
| GeForce RTX 4070 | 12 GB | 504 GB/s | — | — | — | — | $1,087 | 33 |
| GeForce RTX 5060 Ti | 16 GB | 448 GB/s | — | — | — | — | $380 | 29 |
| Apple M3 Ultra 512GB | 512 GB | 819 GB/s | — | — | — | — | $6,199 | 27 |
| Apple M1 Max 64GB | 64 GB | 400 GB/s | — | — | — | — | — | 24 |
| Apple M5 Pro 24GB | 24 GB | 307 GB/s | — | — | — | — | $2,499 | 21 |
| GeForce RTX 4090 | 24 GB | 1,008 GB/s | 330.3 | 660.6 | — | 660.6 | $3,898 | 21 |
| GeForce RTX 3080 | 10 GB | 760 GB/s | 119 | — | — | 238 | — | 19 |
| GeForce RTX 5070 | 12 GB | 672 GB/s | 123.5 | 246.9 | 493.9 | 246.9 | $610 | 19 |
| GeForce RTX 3060 Ti | 8 GB | 448 GB/s | — | — | — | — | — | 18 |
| GeForce RTX 3080 | 12 GB | 912 GB/s | 119 | — | — | 238 | — | 18 |
| GeForce RTX 5080 | 16 GB | 960 GB/s | 225.1 | 450.2 | 900.4 | 450.2 | $1,580 | 14 |
| Intel Arc Pro B60 | 24 GB | 456 GB/s | — | — | — | 197 | $650 | 14 |
| AMD Radeon RX 7700 XT | 12 GB | 432 GB/s | 70.3 | — | — | 70.3 | — | 12 |
| GeForce RTX 5070 Ti | 16 GB | 896 GB/s | 175.8 | 351.5 | 703 | 351.5 | $1,000 | 11 |
| Apple Max 128GB, generation unspecified | 128 GB | — | — | — | — | — | — | 10 |
| GeForce RTX 3090 Ti | 24 GB | 1,008 GB/s | 160 | — | — | 320 | $2,195 | 10 |
| GeForce RTX 3080 Ti | 12 GB | 912 GB/s | 136.4 | — | — | 272.8 | — | 8 |
| Radeon RX 9070 XT | 16 GB | 640 GB/s | 195 | 389 | — | 389 | $740 | 7 |
| GeForce RTX 4060 Ti | 16 GB | 288 GB/s | — | — | — | — | $499 | 6 |
| GeForce RTX 3070 | 8 GB | 448 GB/s | 81.3 | — | — | 162.6 | — | 5 |
| NVIDIA RTX 2000 Ada Generation | 16 GB | 224 GB/s | — | 191.9 * | — | — | $849 | 5 |
| NVIDIA RTX PRO 4000 Blackwell | 24 GB | 672 GB/s | — | — | 1,178 * | — | $3,100 | 5 |
| NVIDIA RTX PRO 4500 Blackwell | 32 GB | 896 GB/s | 406 | 811 | 1,617 * | — | $5,100 | 5 |
| AMD Instinct MI300X | 192 GB | 5,300 GB/s | 1,307.4 | 2,614.9 | — | 2,614.9 | — | 3 |
| Apple M4 16GB | 16 GB | 120 GB/s | — | — | — | — | $799 | 3 |
| GeForce RTX 3070 Ti | 8 GB | 608 GB/s | — | — | — | — | $600 | 3 |
| NVIDIA RTX 4000 Ada Generation | 20 GB | 360 GB/s | — | — | — | — | — | 3 |
| AMD Radeon RX 7900 XT | 20 GB | 800 GB/s | 103 | — | — | 103 | — | 2 |
| Apple M1 Pro 32GB | 32 GB | 200 GB/s | — | — | — | — | — | 2 |
| Apple M3 24GB | 24 GB | 100 GB/s | — | — | — | — | — | 2 |
| Apple M4 Max 64GB | 64 GB | 410–546 GB/s | — | — | — | — | $1,999 | 2 |
| Apple M4 Pro 24GB | 24 GB | 273 GB/s | — | — | — | — | — | 2 |
| Apple M5 Pro 48GB | 48 GB | 307 GB/s | — | — | — | — | $2,499 | 2 |
| GeForce RTX 4060 | 8 GB | 272 GB/s | — | — | — | — | $499 | 2 |
| GeForce RTX 4070 SUPER | 12 GB | 504 GB/s | — | — | — | — | $740 | 2 |
| GeForce RTX 4070 Ti | 12 GB | 504 GB/s | — | — | — | — | — | 2 |
| GeForce RTX 4080 | 16 GB | 717 GB/s | 194.9 | 389.9 | — | 389.9 | $1,799 | 2 |
| GeForce RTX 4080 SUPER | 16 GB | 736 GB/s | — | — | — | — | $1,522 | 2 |
| RTX A6000 | 48 GB | 768 GB/s | 154.8 | — | — | 309.7 | $6,599 | 2 |
| Apple M2 Pro 16GB | 16 GB | 200 GB/s | — | — | — | — | — | 1 |
| Apple M3 Max 128GB | 128 GB | 300–400 GB/s | — | — | — | — | $6,499 | 1 |
| Apple M3 Ultra 96GB | 96 GB | 819 GB/s | — | — | — | — | $6,199 | 1 |
| Apple M4 Max 48GB | 48 GB | 410–546 GB/s | — | — | — | — | $1,999 | 1 |
| Apple M5 32GB | 32 GB | 153 GB/s | — | — | — | — | $1,999 | 1 |
| Apple Pro 64GB, generation unspecified | 64 GB | — | — | — | — | — | — | 1 |
| GeForce RTX 4060 Ti | 8 GB | 288 GB/s | — | — | — | — | $499 | 1 |
| GeForce RTX 4070 Ti SUPER | 16 GB | 672 GB/s | — | — | — | — | $1,266 | 1 |
| GeForce RTX 5060 | 8 GB | 448 GB/s | — | — | — | — | $460 | 1 |
| GeForce RTX 5060 Ti | 8 GB | 448 GB/s | — | — | — | — | $380 | 1 |
| NVIDIA B200 | 180 GB | 7,700 GB/s | 4,500 | — | 9,000 | — | — | 1 |
| RTX 6000 Ada Generation | 48 GB | 960 GB/s | 364.2 | 1,457 * | — | 728.5 | $7,270 | 1 |
| Apple M1 16GB | 16 GB | 68.25 GB/s | — | — | — | — | — | 0 |
| Apple M1 8GB | 8 GB | 68.25 GB/s | — | — | — | — | — | 0 |
| Apple M1 Max 32GB | 32 GB | 400 GB/s | — | — | — | — | — | 0 |
| Apple M1 Pro 16GB | 16 GB | 200 GB/s | — | — | — | — | — | 0 |
| Apple M1 Ultra 128GB | 128 GB | 800 GB/s | — | — | — | — | — | 0 |
| Apple M1 Ultra 64GB | 64 GB | 800 GB/s | — | — | — | — | — | 0 |
| Apple M2 16GB | 16 GB | 100 GB/s | — | — | — | — | — | 0 |
| Apple M2 24GB | 24 GB | 100 GB/s | — | — | — | — | — | 0 |
| Apple M2 8GB | 8 GB | 100 GB/s | — | — | — | — | — | 0 |
| Apple M2 Max 32GB | 32 GB | 400 GB/s | — | — | — | — | — | 0 |
| Apple M2 Max 64GB | 64 GB | 400 GB/s | — | — | — | — | — | 0 |
| Apple M2 Max 96GB | 96 GB | 400 GB/s | — | — | — | — | — | 0 |
| Apple M2 Pro 32GB | 32 GB | 200 GB/s | — | — | — | — | — | 0 |
| Apple M2 Ultra 128GB | 128 GB | 800 GB/s | — | — | — | — | — | 0 |
| Apple M2 Ultra 192GB | 192 GB | 800 GB/s | — | — | — | — | — | 0 |
| Apple M2 Ultra 64GB | 64 GB | 800 GB/s | — | — | — | — | — | 0 |
| Apple M3 16GB | 16 GB | 100 GB/s | — | — | — | — | — | 0 |
| Apple M3 8GB | 8 GB | 100 GB/s | — | — | — | — | — | 0 |
| Apple M3 Max 36GB | 36 GB | 300–400 GB/s | — | — | — | — | $6,499 | 0 |
| Apple M3 Max 48GB | 48 GB | 300–400 GB/s | — | — | — | — | $6,499 | 0 |
| Apple M3 Max 64GB | 64 GB | 300–400 GB/s | — | — | — | — | $6,499 | 0 |
| Apple M3 Max 96GB | 96 GB | 300–400 GB/s | — | — | — | — | $6,499 | 0 |
| Apple M3 Pro 18GB | 18 GB | 150 GB/s | — | — | — | — | — | 0 |
| Apple M3 Pro 36GB | 36 GB | 150 GB/s | — | — | — | — | — | 0 |
| Apple M3 Ultra 256GB | 256 GB | 819 GB/s | — | — | — | — | $6,199 | 0 |
| Apple M4 24GB | 24 GB | 120 GB/s | — | — | — | — | $799 | 0 |
| Apple M4 32GB | 32 GB | 120 GB/s | — | — | — | — | $799 | 0 |
| Apple M4 Pro 64GB | 64 GB | 273 GB/s | — | — | — | — | — | 0 |
| Apple M5 16GB | 16 GB | 153 GB/s | — | — | — | — | $1,999 | 0 |
| Apple M5 24GB | 24 GB | 153 GB/s | — | — | — | — | $1,999 | 0 |
| Apple M5 Max 36GB | 36 GB | 460–614 GB/s | — | — | — | — | $4,099 | 0 |
| Apple M5 Max 48GB | 48 GB | 460–614 GB/s | — | — | — | — | $4,099 | 0 |
| Apple M5 Max 64GB | 64 GB | 460–614 GB/s | — | — | — | — | $4,099 | 0 |
Measured local inference
Best observed values across the registry's cited speed sweeps. The Model variants column counts distinct model-instance records. Model, quantization, engine, context, and concurrency differ between runs; use these as an evidence index, not an equal-workload ranking.
| Hardware | Sweeps | Points | Model variants | Peak prefill | Peak decode | Best TTFT | Max observed context | Peak observed VRAM |
|---|---|---|---|---|---|---|---|---|
| Apple M3 Ultra 96GB 80-core GPU | 241 | 964 | 144 | — | 210.7 tok/s | 5,606.2 ms | 262,080 tokens | 151.6 GB |
| Apple M5 Max 128GB | 254 | 929 | 155 | 67,121.5 tok/s | 484.5 tok/s | 8.3 ms | 262,144 tokens | 124.5 GB |
| Apple M3 Ultra 96GB 60-core GPU | 211 | 843 | 121 | — | 201.8 tok/s | 3,063.7 ms | 262,080 tokens | 437 GB |
| Apple M4 Pro 48GB | 202 | 758 | 117 | 1,092.6 tok/s | 144.5 tok/s | 497 ms | 262,144 tokens | 437 GB |
| Apple M4 Max 128GB | 180 | 719 | 103 | — | 221.6 tok/s | 2,760.1 ms | 262,080 tokens | 109.7 GB |
| Apple M5 Pro 64GB | 176 | 665 | 106 | — | 174.7 tok/s | 221.7 ms | 262,080 tokens | 437 GB |
| Apple M4 Max 36GB | 134 | 536 | 84 | — | 188.6 tok/s | 9,263.3 ms | 262,080 tokens | 122.5 GB |
| RTX PRO 6000 Blackwell | 145 | 235 | 126 | 1,499,853.6 tok/s | 2,527.7 tok/s | 14.5 ms | 1,000,000 tokens | 748.9 GB |
| GeForce RTX 3090 | 159 | 193 | 145 | 328,304.8 tok/s | 666.7 tok/s | 23 ms | 1,048,576 tokens | 184.4 GB |
| GeForce RTX 3060 | 178 | 178 | 163 | 20,862.1 tok/s | 401.4 tok/s | 1 ms | 262,144 tokens | 22.9 GB |
| GeForce RTX 5090 | 139 | 169 | 130 | 1,495,084.3 tok/s | 582.5 tok/s | 0.5 ms | 262,144 tokens | 124 GB |
| Intel Arc Pro B70 | 141 | 164 | 126 | 12,400 tok/s | 1,139.8 tok/s | 57.8 ms | 262,144 tokens | 127.5 GB |
| NVIDIA DGX Spark GB10 | 75 | 115 | 67 | 29,476 tok/s | 807.3 tok/s | 132.2 ms | 1,048,576 tokens | 334.4 GB |
| Ryzen AI Max+ 395 | 104 | 104 | 103 | 5,084 tok/s | 137.9 tok/s | 98.8 ms | 500,000 tokens | 95 GB |
| Radeon AI PRO R9700 | 101 | 101 | 95 | 9,649.1 tok/s | 6,001.4 tok/s | 0.2 ms | 262,144 tokens | 101.9 GB |
| Radeon RX 7900 XTX | 42 | 42 | 41 | 29,076 tok/s | 576.9 tok/s | 59 ms | 262,144 tokens | 24.2 GB |
| GeForce RTX 4070 | 33 | 33 | 33 | 88,024.2 tok/s | 131.9 tok/s | 1 ms | 262,144 tokens | 11.9 GB |
| GeForce RTX 4090 | 21 | 30 | 20 | 583,241.9 tok/s | 213.9 tok/s | 76.3 ms | 172,032 tokens | 23,691 GB |
| GeForce RTX 5060 Ti | 29 | 29 | 29 | 3,469.9 tok/s | 280.9 tok/s | 21.6 ms | 262,144 tokens | 16 GB |
| Apple M3 Ultra 512GB | 27 | 27 | 27 | 2,247.2 tok/s | 213 tok/s | 23.9 ms | 40,960,000 tokens | 336.1 GB |
| Apple M1 Max 64GB | 24 | 24 | 22 | 6,011.9 tok/s | 83.6 tok/s | 23.8 ms | 2,048 tokens | — |
| Apple M5 Pro 24GB | 21 | 21 | 21 | 5,820.1 tok/s | 267.8 tok/s | 49.2 ms | 8,192 tokens | — |
| GeForce RTX 3080 | 19 | 19 | 18 | 10,731.8 tok/s | 328.4 tok/s | 260.5 ms | 262,144 tokens | 9.6 GB |
| GeForce RTX 5070 | 19 | 19 | 19 | 7,615.8 tok/s | 265.5 tok/s | 46.7 ms | 131,072 tokens | 10.2 GB |
| GeForce RTX 3060 Ti | 18 | 18 | 18 | 15,047.6 tok/s | 370.3 tok/s | 54.3 ms | 131,072 tokens | 7.5 GB |
| AMD Instinct MI300X | 3 | 18 | 3 | 636,780 tok/s | — | 200.1 ms | 130,560 tokens | — |
| GeForce RTX 3080 | 17 | 17 | 15 | 5,183.9 tok/s | 149 tok/s | — | 2,048 tokens | 9.8 GB |
| Intel Arc Pro B60 | 14 | 14 | 14 | 8,333.5 tok/s | 194.7 tok/s | 61.4 ms | 4,096 tokens | — |
| GeForce RTX 5080 | 13 | 13 | 13 | 35,896.7 tok/s | 448.1 tok/s | 14.3 ms | 262,144 tokens | 14.2 GB |
| NVIDIA RTX PRO 4000 Blackwell | 4 | 13 | 3 | 436,348 tok/s | 58.4 tok/s | 283.6 ms | 131,072 tokens | — |
| NVIDIA RTX PRO 4500 Blackwell | 4 | 13 | 4 | 997,269.2 tok/s | 45 tok/s | 86.4 ms | 262,144 tokens | — |
| AMD Radeon RX 7700 XT | 12 | 12 | 12 | 2,442.9 tok/s | 156.7 tok/s | 40.6 ms | 2,048 tokens | — |
| GeForce RTX 5070 Ti | 11 | 11 | 11 | 28,408.8 tok/s | 402.3 tok/s | 16 ms | 262,144 tokens | — |
| Apple Max 128GB, generation unspecified | 10 | 10 | 10 | 1,100 tok/s | 135 tok/s | 250 ms | 131,072 tokens | 60.3 GB |
| GeForce RTX 3090 Ti | 10 | 10 | 10 | — | 155.9 tok/s | 67.6 ms | 131,072 tokens | 22 GB |
| GeForce RTX 3080 Ti | 8 | 8 | 7 | — | 101.5 tok/s | 352.8 ms | 250,000 tokens | — |
| Apple M3 24GB | 2 | 8 | 2 | — | 7.4 tok/s | 1,708,332 ms | 147,392 tokens | 17.7 GB |
| Radeon RX 9070 XT | 7 | 7 | 7 | 399 tok/s | 545.3 tok/s | 67 ms | 131,072 tokens | 15.5 GB |
| NVIDIA RTX 2000 Ada Generation | 2 | 7 | 2 | 184,386.1 tok/s | — | 693.4 ms | 130,560 tokens | — |
| GeForce RTX 4060 Ti | 6 | 6 | 6 | 971.8 tok/s | 60.2 tok/s | 217.5 ms | 262,144 tokens | — |
| NVIDIA RTX 4000 Ada Generation | 2 | 5 | 2 | 357,665.3 tok/s | 60.2 tok/s | 257.4 ms | 262,144 tokens | — |
| GeForce RTX 3070 | 4 | 4 | 4 | — | 67.2 tok/s | 150.8 ms | 131,072 tokens | — |
| Apple M3 Max 128GB | 1 | 4 | 1 | — | 17 tok/s | 211,570 ms | 262,080 tokens | 37.4 GB |
| Apple M4 16GB | 3 | 3 | 3 | 36.9 tok/s | 21.6 tok/s | 1,287.9 ms | 4,096 tokens | 9.9 GB |
| GeForce RTX 3070 Ti | 3 | 3 | 3 | — | 276.3 tok/s | 305.5 ms | 262,144 tokens | 7,949 GB |
| AMD Radeon RX 7900 XT | 2 | 2 | 2 | 1,191.7 tok/s | 116 tok/s | 32.7 ms | 2,048 tokens | — |
| Apple M1 Pro 32GB | 2 | 2 | 2 | 334.9 tok/s | 32.2 tok/s | 95.5 ms | 262,144 tokens | 26 GB |
| Apple M4 Max 64GB | 2 | 2 | 2 | — | 83.4 tok/s | 105.8 ms | 262,144 tokens | 25.9 GB |
| Apple M4 Pro 24GB | 2 | 2 | 2 | 2,385.5 tok/s | 61 tok/s | — | 2,048 tokens | 1.4 GB |
| Apple M5 Pro 48GB | 2 | 2 | 2 | 250.7 tok/s | 189.3 tok/s | 133.6 ms | 2,048 tokens | 34.2 GB |
| GeForce RTX 4060 | 2 | 2 | 2 | 494.3 tok/s | 42.9 tok/s | 793.3 ms | 131,072 tokens | 7.3 GB |
| GeForce RTX 4070 SUPER | 2 | 2 | 2 | — | 82 tok/s | 164 ms | 131,072 tokens | 7 GB |
| GeForce RTX 4070 Ti | 2 | 2 | 2 | — | 81.7 tok/s | 486.9 ms | 131,072 tokens | — |
| GeForce RTX 4080 | 2 | 2 | 2 | — | 102.1 tok/s | 376.6 ms | 262,144 tokens | — |
| GeForce RTX 4080 SUPER | 2 | 2 | 2 | — | 106.7 tok/s | 407.3 ms | 262,144 tokens | — |
| RTX A6000 | 2 | 2 | 2 | — | 165.6 tok/s | 127.1 ms | 262,144 tokens | 82.8 GB |
| Apple M2 Pro 16GB | 1 | 1 | 1 | — | 33 tok/s | 1,400 ms | 4,096 tokens | — |
| Apple M3 Ultra 96GB | 1 | 1 | 1 | — | 38.3 tok/s | — | 262,144 tokens | — |
| Apple M4 Max 48GB | 1 | 1 | 1 | — | 21.8 tok/s | 0.8 ms | 4,096 tokens | — |
| Apple M5 32GB | 1 | 1 | 1 | 103.5 tok/s | 34.3 tok/s | — | 64,000 tokens | — |
| Apple Pro 64GB, generation unspecified | 1 | 1 | 1 | — | 105 tok/s | 109.3 ms | 2,048 tokens | 3 GB |
| GeForce RTX 4060 Ti | 1 | 1 | 1 | — | 47.9 tok/s | 172.6 ms | 131,072 tokens | — |
| GeForce RTX 4070 Ti SUPER | 1 | 1 | 1 | — | 106 tok/s | 355.8 ms | 262,144 tokens | — |
| GeForce RTX 5060 | 1 | 1 | 1 | — | 60.3 tok/s | 930.5 ms | 131,072 tokens | — |
| GeForce RTX 5060 Ti | 1 | 1 | 1 | — | 63.7 tok/s | 2,427.8 ms | 131,072 tokens | — |
| RTX 6000 Ada Generation | 1 | 1 | 1 | — | 49.5 tok/s | 524.6 ms | 262,144 tokens | — |