COLLECTION / RECIPES

Recipes

One artifact × hardware × engine unit. Validated rows are launch-safe; measured speed sweeps attach to each recipe as evidence.

156 records

GeForce RTX 30901 × 24 GBQwen3.8-27BQ6_K_XLllama.cppreferenceUnknown contextcontext51.5 tok/smeasuredcandidate llama.cpp evidence measured

RTX 6000 Ada Generation1 × 48 GBQwen3.8-27B4 bpwtabbyapidocker256Kcontext49.5 tok/smeasuredvalidated tabbyapi docker measured

RTX PRO 6000 Blackwell1 × 96 GBDeepSeek-Coder-V2-Lite-InstructFP8vllmreferenceUnknown contextcontext237.3 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBDeepSeek-V4-FlashIQ3_XXSllama.cppreference256Kcontext80.8 tok/smeasuredcandidate llama.cpp evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-FlashFP8sglangdocker-compose293.0Kcontext38 tok/smeasuredcandidate sglang docker measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashFP8vllmreference255.9Kcontext261.8 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashFP8vllmreferenceUnknown contextcontext249.2 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashFP8vllmreferenceUnknown contextcontext181.3 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashFP8vllmreferenceUnknown contextcontext255.5 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-FlashFP8vllmreferenceUnknown contextcontext310 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-FlashFP8vllmreferenceUnknown contextcontext308.2 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-FlashFP8vllmreferenceUnknown contextcontext217.5 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashNVFP4vllmreference255.9Kcontext181 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-Flash-0731FP8sglangdocker128Kcontext57.9 tok/smeasuredcandidate sglang docker measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-Flash-0731FP8_E4M3vllmreference256Kcontext276 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-Flash-0731FP8vllmreferenceUnknown contextcontext238.8 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-Flash-0731FP8vllmcontroller1024Kcontext—no evidencecandidate vllm no docker unmeasured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-Flash-0731MXFP4vllmreference256Kcontext231.5 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-Flash-DSparkFP8vllmreference255.9Kcontext261.8 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBdiffusiongemma-26B-A4Bbf16vllmreferenceUnknown contextcontext528.7 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBgemma-4-12BBF16vllmreferenceUnknown contextcontext145.6 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBgemma-4-12BBF16vllmreferenceUnknown contextcontext86.9 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBgemma-4-12BBF16vllmreferenceUnknown contextcontext132.2 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBGemma-4-12B-itNVFP4sglangdocker128Kcontext38.3 tok/smeasuredvalidated sglang docker measured