COLLECTION / RECIPES

Recipes

One artifact × hardware × engine unit. Validated rows are launch-safe; measured speed sweeps attach to each recipe as evidence.

2,330 records

Radeon RX 9070 XT1 × 16 GBQwen3.6-35B-A3BUD-Q2_K_XLllama.cppreference32Kcontext96.6 tok/smeasuredcandidate llama.cpp evidence measured

RTX 6000 Ada Generation1 × 48 GBQwen3.8-27B4 bpwtabbyapidocker256Kcontext49.5 tok/smeasuredvalidated tabbyapi docker measured

RTX A60002 × 48 GBQwen3.6-27Bint4vllmreferenceUnknown contextcontext165.6 tok/smeasuredcandidate vllm evidence measured

RTX A60001 × 48 GBQwen3.8-27B4 bpwtabbyapidocker256Kcontext36.7 tok/smeasuredvalidated tabbyapi docker measured

RTX PRO 6000 Blackwell1 × 96 GBDeepSeek-Coder-V2-Lite-InstructFP8vllmreferenceUnknown contextcontext237.3 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBDeepSeek-V4-FlashIQ3_XXSllama.cppreference256Kcontext80.8 tok/smeasuredcandidate llama.cpp evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-FlashFP8sglangdocker-compose293.0Kcontext38 tok/smeasuredcandidate sglang docker measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashFP8vllmreference255.9Kcontext261.8 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashFP8vllmreferenceUnknown contextcontext249.2 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashFP8vllmreferenceUnknown contextcontext181.3 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashFP8vllmreferenceUnknown contextcontext255.5 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-FlashFP8vllmreferenceUnknown contextcontext310 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-FlashFP8vllmreferenceUnknown contextcontext308.2 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-FlashFP8vllmreferenceUnknown contextcontext217.5 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-FlashNVFP4vllmreference255.9Kcontext181 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-Flash-0731FP8sglangdocker128Kcontext57.9 tok/smeasuredcandidate sglang docker measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-Flash-0731FP8_E4M3vllmreference256Kcontext276 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-Flash-0731FP8vllmreferenceUnknown contextcontext238.8 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-Flash-0731FP8vllmcontroller1024Kcontext—no evidencecandidate vllm no docker unmeasured

RTX PRO 6000 Blackwell4 × 96 GBDeepSeek-V4-Flash-0731MXFP4vllmreference256Kcontext231.5 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBDeepSeek-V4-Flash-DSparkFP8vllmreference255.9Kcontext261.8 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBdiffusiongemma-26B-A4Bbf16vllmreferenceUnknown contextcontext528.7 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBgemma-4-12BBF16vllmreferenceUnknown contextcontext145.6 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBgemma-4-12BBF16vllmreferenceUnknown contextcontext86.9 tok/smeasuredcandidate vllm evidence measured