COLLECTION / RECIPES

Recipes

One artifact × hardware × engine unit. Validated rows are launch-safe; measured speed sweeps attach to each recipe as evidence.

166 records

GeForce RTX 30901 × 24 GBbonsai-27bQ1_0llama.cppreference512context57 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 30902 × 24 GBCarnice-9bAWQvllmreference2Kcontext114.3 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 30901 × 24 GBDeepSeek-R1-Distill-Qwen-14BQ4_K_Mllama.cppreference512context50.9 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 30901 × 24 GBDeepSeek-R1-Distill-Qwen-32BQ4_K_Mllama.cppreference512context23.3 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 30901 × 24 GBDeepSeek-V4-FlashIQ2_XXSllama.cppreference26.0Kcontext11 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 30901 × 24 GBDeepSeek-V4-Flash-0731IQ2_XSSllama.cppreference2Kcontext20.7 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 30904 × 24 GBDeepSeek-V4-Flash-0731UD-IQ2_Mllama.cppreference128Kcontext41.1 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 30907 × 24 GBDeepSeek-V4-Flash-0731UD-IQ4_XSllama.cppreference256Kcontext50.8 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 30907 × 24 GBDeepSeek-V4-Flash-0731UD-Q4_K_XLllama.cppreference256Kcontext33.9 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 30908 × 24 GBDeepSeek-V4-Flash-0731FP8_E4M3vllmreferenceUnknown contextcontext91.2 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 30908 × 24 GBDeepSeek-V4-Flash-0731FP8vllmreferenceUnknown contextcontext404.5 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 30902 × 24 GBdiffusiongemma-26B-A4B-itFP8 dynamicvllmreferenceUnknown contextcontext177.6 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 30901 × 24 GBgemma-3-12b-ptQ4_K_Mllama.cppreference512context66 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 30901 × 24 GBgemma-4-12BQ4_K_Mllama.cppreference512context57 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 30901 × 24 GBGemma-4-12B-itQ4_K_Mllama.cppreference512context57 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 30901 × 24 GBGemma-4-12B-it4 bpwtabbyapidocker128Kcontext26.6 tok/smeasuredvalidated tabbyapi docker measured

GeForce RTX 30901 × 24 GBgemma-4-12B-it-qat-q4_0-unquantizedUD-Q4_K_XLllama.cppreference512context126.5 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 30902 × 24 GBgemma-4-26B-A4BINT8_W8A16vllmreferenceUnknown contextcontext162.9 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 30901 × 24 GBgemma-4-26B-A4B-it-qat-q4_0-unquantizedQ4_K_Mllama.cppreference2Kcontext147.7 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 30901 × 24 GBgemma-4-26B-A4B-it-qat-q4_0-unquantizedQ4_K_XLllama.cppreference1Kcontext152.8 tok/smeasuredcandidate llama.cpp evidence measured

GeForce RTX 30902 × 24 GBgemma-4-31Bint4vllmreferenceUnknown contextcontext135.1 tok/smeasuredcandidate vllm evidence measured

GeForce RTX 30902 × 24 GBgemma-4-31Bint8vllmreferenceUnknown contextcontext87.7 tok/smeasuredcandidate vllm evidence measured