COLLECTION / RECIPES

Recipes

One artifact × hardware × engine unit. Validated rows are launch-safe; measured speed sweeps attach to each recipe as evidence.

2,330 records

GeForce RTX 50901 × 32 GBgemma-4-26B-A4B-itQ4_K_MlmstudioreferenceUnknown contextcontext209.8 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBgemma-4-26B-A4B-itINT4vllmreferenceUnknown contextcontext378.1 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 50901 × 32 GBgemma-4-26B-A4B-it-qat-q4_0-unquantizedQ4_0lmstudioreferenceUnknown contextcontext254.3 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBgemma-4-26B-A4B-it-qat-q4_0-unquantizedQ4_0ollamareferenceUnknown contextcontext230.5 tok/smeasuredcandidate ollama evidence measured

GeForce RTX 50901 × 32 GBgemma-4-31BQ8_0llama.cppreferenceUnknown contextcontext38 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBgemma-4-31BUD-Q4_K_XL-QATllama.cppreference8Kcontext68.5 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBgemma-4-31BUD-Q6_K_XLllama.cppreference8Kcontext46.5 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBGemma-4-31B-itQ6_K_XLllama.cppreferenceUnknown contextcontext51.7 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBgemma-4-31B-it-qat-q4_0-unquantizedQ4_K_XLllama.cppreference195.3Kcontext207.6 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBgemma-4-e2b-itQ4_K_MlmstudioreferenceUnknown contextcontext232.6 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBgemma-4-e4b-itQ8_0lmstudioreferenceUnknown contextcontext161.5 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBGLM-4.6V-FlashQ8_0lmstudioreferenceUnknown contextcontext132.7 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBGLM-4.7-FlashQ5_K_Mllama.cppreference128Kcontext219.3 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBGLM-4.7-FlashUD-Q6_K_XLllama.cppreference8Kcontext175.9 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBGLM-4.7-FlashQ4_K_MlmstudioreferenceUnknown contextcontext182.5 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBGLM-4.7-FlashINT4vllmreferenceUnknown contextcontext163.4 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 50901 × 32 GBgpt-oss-20bMXFP4lmstudioreferenceUnknown contextcontext307.2 tok/smeasuredcandidate lmstudio evidence measured

GeForce RTX 50901 × 32 GBHuihui-Qwen3.6-27B-abliteratedNVFP4vllmreferenceUnknown contextcontext105.3 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 50901 × 32 GBHuihui-Qwen3.8-27B-abliteratedNVFP4vllmreferenceUnknown contextcontext178 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 50904 × 32 GBHy3IQ1_Mllama.cppreferenceUnknown contextcontext87.1 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50901 × 32 GBKAT-Coder-V2.5-DevW4A16vllmreferenceUnknown contextcontext201.2 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 50901 × 32 GBKimi-Linear-48B-A3B-InstructIQ4_XSllama.cppreference32Kcontext280.8 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 50904 × 32 GBlaguna-s-2.1NVFP4vllmreference256Kcontext157.1 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 50901 × 32 GBlaguna-xs-2.1INT4vllmreferenceUnknown contextcontext206.2 tok/smeasuredcandidate vllm evidence measured