COLLECTION / RECIPES

Recipes

One artifact × hardware × engine unit. Validated rows are launch-safe; measured speed sweeps attach to each recipe as evidence.

14 records

GeForce RTX 5060 Ti2 × 16 GBQwen3.6-27Bnvfp4vllmreferenceUnknown contextcontext15.9 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 50901 × 32 GBQwen3.6-27Bnvfp4llama.cppreference128Kcontext51.2 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBQwen3.6-27BNVFP4 modelopt-mixed W4A16+FP8vllmreferenceUnknown contextcontext66.9 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 50901 × 32 GBQwen3.6-27BNVFP4vllmreference128Kcontext57.5 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 50901 × 32 GBQwen3.6-27BNVFP4vllmreference128Kcontext120.9 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 50901 × 32 GBQwen3.6-27Bnvfp4vllmreference128Kcontext55 tok/smeasuredcandidate vllm evidence measured

NVIDIA DGX Spark GB101 × 128 GBQwen3.6-27BNVFP4vllmreference2Kcontext40.1 tok/smeasuredcandidate vllm evidence measured

NVIDIA DGX Spark GB101 × 128 GBQwen3.6-27BNVFP4vllmreference256Kcontext32.8 tok/smeasuredcandidate vllm evidence measured

NVIDIA DGX Spark GB101 × 128 GBQwen3.6-27Bnvfp4vllmdockerUnknown contextcontext—no evidencecandidate vllm docker unmeasured

RTX PRO 6000 Blackwell1 × 96 GBQwen3.6-27Bnvfp4tensorrt-llmreference128Kcontext69.7 tok/smeasuredcandidate tensorrt-llm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBQwen3.6-27BNVFP4vllmreference2Kcontext140 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell1 × 96 GBQwen3.6-27Bnvfp4vllmreference2Kcontext128.7 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell2 × 96 GBQwen3.6-27Bnvfp4vllmreference2Kcontext177.7 tok/smeasuredcandidate vllm evidence measured

RTX PRO 6000 Blackwell4 × 96 GBQwen3.6-27Bnvfp4vllmreference2Kcontext168.1 tok/smeasuredcandidate vllm evidence measured