READ-ONLY / SOURCE-BACKED

Registry index

VALIDATED / LAUNCH-SAFE

Launch-safe recipes

LFM2.5-2.6BBF16AMD Instinct MI300X1 × 192 GBsglangdocker128Kcontext122.2 tok/smeasuredvalidated sglang docker measured

Ornith-1.5-35B-A3BBF16AMD Instinct MI300X1 × 192 GBsglangdocker128Kcontext96.8 tok/smeasuredvalidated sglang docker measured

Qwen3.8-27BFP8AMD Instinct MI300X1 × 192 GBsglangdocker128Kcontext25.3 tok/smeasuredvalidated sglang docker measured

Qwen3.5-9B4 bpwGeForce RTX 30601 × 12 GBtabbyapidocker128Kcontext48 tok/smeasuredvalidated tabbyapi docker measured

LFM2.5-2.6BBF16GeForce RTX 3060 Ti1 × 8 GBsglangdocker128Kcontext64.2 tok/smeasuredvalidated sglang docker measured

LFM2.5-2.6BBF16GeForce RTX 30701 × 8 GBsglangdocker128Kcontext67.2 tok/smeasuredvalidated sglang docker measured

LFM2.5-2.6BBF16GeForce RTX 3070 Ti1 × 8 GBsglangdocker128Kcontext85.2 tok/smeasuredvalidated sglang docker measured

LFM2.5-8B-A1BQ4_K_MGeForce RTX 3070 Ti1 × 8 GBllama.cppdocker32Kcontext276.3 tok/smeasuredvalidated llama.cpp docker measured