COLLECTION / RECIPES

Recipes

One artifact × hardware × engine unit. Validated rows are launch-safe; measured speed sweeps attach to each recipe as evidence.

10 records

GeForce RTX 30902 × 24 GBNVIDIA-Nemotron-3.5NVFP4vllmreference128Kcontext197 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 30901 × 24 GBNVIDIA-Nemotron-3.5Q4_K_Mvllmreference2Kcontext202.6 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 40701 × 12 GBNVIDIA-Nemotron-3.5Q4_K_Mllama.cppreference4Kcontext43.5 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBNVIDIA-Nemotron-3.5NVFP4vllmreference64Kcontext446.7 tok/smeasuredcandidate vllm evidence measured

Intel Arc Pro B701 × 32 GBNVIDIA-Nemotron-3.5GPTQ-INT4-G64-sym-local+DFlash-BF16-localvllmreference16Kcontext186.6 tok/smeasuredcandidate vllm evidence measured

Intel Arc Pro B701 × 32 GBNVIDIA-Nemotron-3.5GPTQ-INT4-G64-sym-localvllmreference16Kcontext93 tok/smeasuredcandidate vllm evidence measured

Intel Arc Pro B701 × 32 GBNVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16Q4_0llama.cppreference16Kcontext87.4 tok/smeasuredcandidate llama.cpp evidence measured

Intel Arc Pro B701 × 32 GBNVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16Q4_K_Mllama.cppreference16Kcontext49.8 tok/smeasuredcandidate llama.cpp evidence measured

NVIDIA DGX Spark GB101 × 128 GBNVIDIA-Nemotron-3.5NVFP4sglangdockerUnknown contextcontext—no evidencecandidate sglang docker unmeasured