COLLECTION / RECIPES

Recipes

One artifact × hardware × engine unit. Validated rows are launch-safe; measured speed sweeps attach to each recipe as evidence.

138 records

GeForce RTX 50901 × 32 GBbonsai-27bQ1_0lmstudioreference2Kcontext136.7 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBDeepSeek-R1-0528-Qwen3-8BQ8_0lmstudioreference2Kcontext141.5 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBDeepSeek-R1-Distill-Qwen-7BQ4_K_Mlmstudioreference2Kcontext213.3 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50904 × 32 GBDeepSeek-V4-Flash2-bit experts (vLLM-Moet W2) + FP8 KVvllmreferenceUnknown contextcontext212 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 50901 × 32 GBDeepSeek-V4-Flash-0731IQ1_Sllama.cppreference2Kcontext17.5 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBDeepSeek-V4-Flash-0731MXFP4llama.cppreference192Kcontext26.4 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBDeepSeek-V4-Flash-0731Q8_K_XLllama.cppreference2Kcontext10.4 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBDeepSeek-V4-Flash-0731UD-IQ1_Sllama.cppreference2Kcontext18 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBgemma-3n-E4B-it-text-GGUFQ8_0lmstudioreference2Kcontext135.4 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBgemma-4-12BUD-Q8_K_XLllama.cppreference8Kcontext87.2 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBgemma-4-12B-coder-fable5-composer2.5-v1-GGUFNVFP4vllmreferenceUnknown contextcontext183 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 50901 × 32 GBGemma-4-12B-itQ8_0lmstudioreference2Kcontext88.3 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBGemma-4-12B-itQ8_0lmstudioreference2Kcontext85.3 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBGemma-4-12B-itNVFP4sglangdocker128Kcontext39.9 tok/smeasuredcandidate sglang docker measured

GeForce RTX 50901 × 32 GBgemma-4-12B-it-qat-q4_0-unquantizedQ4_0lmstudioreference2Kcontext130.8 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBgemma-4-26B-A4BINT8vllmreferenceUnknown contextcontext296.4 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 50901 × 32 GBgemma-4-26B-A4B-itQ3_K_Mllama.cppreference2Kcontext255.7 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBgemma-4-26B-A4B-itQ4_K_Mlmstudioreference2Kcontext209.8 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBgemma-4-26B-A4B-itINT4vllmreferenceUnknown contextcontext378.1 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 50901 × 32 GBgemma-4-26B-A4B-it-qat-q4_0-unquantizedQ4_0lmstudioreference2Kcontext254.3 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBgemma-4-26B-A4B-it-qat-q4_0-unquantizedQ4_0ollamareference128Kcontext230.5 tok/smeasuredcandidate ollama evidence measured

GeForce RTX 50901 × 32 GBgemma-4-31BQ8_0llama.cppreference2Kcontext38 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBgemma-4-31BUD-Q4_K_XL-QATllama.cppreference8Kcontext68.5 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBgemma-4-31BUD-Q6_K_XLllama.cppreference8Kcontext46.5 tok/smeasuredcandidate llama.cpp evidence measured