COLLECTION / RECIPES

Recipes

One artifact × hardware × engine unit. Validated rows are launch-safe; measured speed sweeps attach to each recipe as evidence.

2,330 records

RTX PRO 6000 Blackwell2 × 96 GBgemma-4-12BBF16vllmreferenceUnknown contextcontext132.2 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBGemma-4-12B-itNVFP4sglangdocker128Kcontext38.3 tok/smeasuredvalidated sglang docker measured

RTX PRO 6000 Blackwell1 × 96 GBgemma-4-26B-A4Bint8_per_channel_weight_onlyvllmreferenceUnknown contextcontext276.7 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBgemma-4-26B-A4B-itNVFP4 (modelopt_fp4 W4A4)vllmreferenceUnknown contextcontext65.5 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBgemma-4-26B-A4B-itNVFP4vllmreferenceUnknown contextcontext8 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBgemma-4-31BBF16vllmreferenceUnknown contextcontext98.2 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBgemma-4-31BBF16vllmreference32Kcontext71.8 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBgemma-4-31BFP8vllmreferenceUnknown contextcontext58.6 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBGemma-4-31B-itBF16vllmcontrollerUnknown contextcontext—no evidencecandidate vllm no docker unmeasured

RTX PRO 6000 Blackwell2 × 96 GBGemma-4-31B-itNVFP4vllmcontrollerUnknown contextcontext—no evidencecandidate vllm no docker unmeasured

RTX PRO 6000 Blackwell1 × 96 GBGLM-4.5-AirAWQ-4bitvllmreferenceUnknown contextcontext2,527.7 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell8 × 96 GBGLM-5.1-NVFP4NVFP4sglangreferenceUnknown contextcontext74.5 tok/smeasuredcandidate sglang evidence measured

RTX PRO 6000 Blackwell4 × 96 GBGLM-5.2UD-IQ4_XSllama.cppreference64Kcontext39.8 tok/smeasuredcandidate llama.cpp evidence measured

RTX PRO 6000 Blackwell4 × 96 GBGLM-5.2UD-Q2_K_MXFP4llama.cppreference512Kcontext47.9 tok/smeasuredcandidate llama.cpp evidence measured

RTX PRO 6000 Blackwell4 × 96 GBGLM-5.2MXFP8_NVFP4_NF3vllmreference128Kcontext36.8 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBGLM-5.2NVFP4vllmreference468.8Kcontext79.6 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBGLM-5.23.0 bpwvllmdocker256Kcontext188.1 tok/smeasuredvalidated vllm docker measured

RTX PRO 6000 Blackwell4 × 96 GBGLM-5.2MXFP8/NVFP4/NF3 hybridvllmdocker-compose175.8Kcontext58.2 tok/smeasuredcandidate vllm docker measured

RTX PRO 6000 Blackwell4 × 96 GBGLM-5.2NVFP4 REAPvllmdocker-compose244.1Kcontext60 tok/smeasuredcandidate vllm docker measured

RTX PRO 6000 Blackwell4 × 96 GBGLM-5.2NVFP4 non-uniform REAPvllmdocker-compose256Kcontext77 tok/smeasuredcandidate vllm docker measured

RTX PRO 6000 Blackwell4 × 96 GBGLM-5.2-MXFP8-NVFP4-NF3-HybridMXFP8-NVFP4-NF3-HybridvllmreferenceUnknown contextcontext92 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBGLM-5.2-NVFP4NVFP4vllmreferenceUnknown contextcontext52.6 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBGLM-5.2-NVFP4NVFP4vllmreferenceUnknown contextcontext87.1 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBGLM-5.2-Vision3.0 bpw text + BF16 visionvllmcontroller390.6Kcontext70.7 tok/smeasuredcandidate vllm no docker measured