COLLECTION / COMPARE

Compare hardware

Every accelerator side by side: memory, vendor-published throughput, the lowest live US listing, and how many launch recipes the registry holds. Click a column to rank by it; * marks structured-sparsity figures where the vendor publishes no dense number.

7 devices · 7 measured

Published specifications

Vendor-published compute figures. Missing precision columns remain blank instead of being estimated from a different datatype or sparse mode.

Hardware	VRAM	Bandwidth	FP16 TFLOPS	FP8 TFLOPS	FP4 TFLOPS	INT8 TOPS	Lowest new (US)	▾ Recipes
Ryzen AI Max+ 395	128 GB	256 GB/s	60	—	—	—	$2,599	104
Radeon AI PRO R9700	32 GB	640 GB/s	191	383	—	383	$1,300	101
Radeon RX 7900 XTX	24 GB	960 GB/s	123	—	—	123	—	42
AMD Radeon RX 7700 XT	12 GB	432 GB/s	70.3	—	—	70.3	—	12
Radeon RX 9070 XT	16 GB	640 GB/s	195	389	—	389	$740	7
AMD Instinct MI300X	192 GB	5,300 GB/s	1,307.4	2,614.9	—	2,614.9	—	3
AMD Radeon RX 7900 XT	20 GB	800 GB/s	103	—	—	103	—	2

Measured local inference

Best observed values across the registry's cited speed sweeps. The Model variants column counts distinct model-instance records. Model, quantization, engine, context, and concurrency differ between runs; use these as an evidence index, not an equal-workload ranking.

Hardware	Sweeps	Points	Model variants	Peak prefill	Peak decode	Best TTFT	Max observed context	Peak observed VRAM
Ryzen AI Max+ 395	104	104	103	5,084 tok/s	137.9 tok/s	98.8 ms	500,000 tokens	95 GB
Radeon AI PRO R9700	101	101	95	9,649.1 tok/s	6,001.4 tok/s	0.2 ms	262,144 tokens	101.9 GB
Radeon RX 7900 XTX	42	42	41	29,076 tok/s	576.9 tok/s	59 ms	262,144 tokens	24.2 GB
AMD Instinct MI300X	3	18	3	636,780 tok/s	—	200.1 ms	130,560 tokens	—
AMD Radeon RX 7700 XT	12	12	12	2,442.9 tok/s	156.7 tok/s	40.6 ms	2,048 tokens	—
Radeon RX 9070 XT	7	7	7	399 tok/s	545.3 tok/s	67 ms	131,072 tokens	15.5 GB
AMD Radeon RX 7900 XT	2	2	2	1,191.7 tok/s	116 tok/s	32.7 ms	2,048 tokens	—