COLLECTION / RECIPES

Recipes

One artifact × hardware × engine unit. Validated rows are launch-safe; measured speed sweeps attach to each recipe as evidence.

157 records

RTX PRO 6000 Blackwell1 × 96 GBDeepSeekFP8vllmreferenceUnknown contextcontext237.3 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBDeepSeek-V4-FlashIQ3_XXSllama.cppreference256Kcontext80.8 tok/smeasuredcandidate llama.cpp evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-FlashFP8sglangdocker-compose293.0Kcontext38 tok/smeasuredcandidate sglang docker measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashFP8vllmreference255.9Kcontext261.8 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashFP8vllmreference2Kcontext249.2 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashFP8vllmreference2Kcontext181.3 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashFP8vllmreference2Kcontext255.5 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-FlashFP8vllmreference2Kcontext310 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-FlashFP8vllmreference2Kcontext308.2 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-FlashFP8vllmreference2Kcontext217.5 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashNVFP4vllmreference488.3Kcontext181 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-Flash-0731FP8sglangdocker128Kcontext57.9 tok/smeasuredcandidate sglang docker measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-Flash-0731FP8_E4M3vllmreference256Kcontext276 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-Flash-0731FP8vllmreference2Kcontext238.8 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-Flash-0731FP8vllmcontroller1024Kcontext—no evidencecandidate vllm no docker unmeasured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-Flash-0731MXFP4vllmreference2Kcontext231.5 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-Flash-DSparkFP8vllmreference255.9Kcontext261.8 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBdiffusiongemma-26B-A4Bbf16vllmreferenceUnknown contextcontext528.7 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBgemma-4-12BBF16vllmreferenceUnknown contextcontext145.6 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBgemma-4-12BBF16vllmreference2Kcontext86.9 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBgemma-4-12BBF16vllmreference2Kcontext132.2 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBGemma-4-12B-itNVFP4sglangdocker128Kcontext38.3 tok/smeasuredvalidated sglang docker measured

RTX PRO 6000 Blackwell1 × 96 GBgemma-4-26B-A4Bint8_per_channel_weight_onlyvllmreferenceUnknown contextcontext276.7 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBgemma-4-26B-A4B-itNVFP4 (modelopt_fp4 W4A4)vllmreferenceUnknown contextcontext1,048 tok/smeasuredcandidate vllm evidence measured