Recipe

qwen3-6-27b-mq4-ryzen-ai-max-plus-395-128gb-hipfire-tp1

qwen3-6-27b-mq4-ryzen-ai-max-plus-395-128gb-hipfire-tp1

JSON API Find compatible recipes

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status: candidate
Source: localmaxxing
Engine: hipfire
Engine version: 0.3.0+98d3567
Accelerators: 1
Tensor parallel: 1
Context tokens: 2,048
chat: unknown
reasoning: unknown
tools: unknown
vision: unknown

Hugging Face model card

Identity

https://huggingface.co/Qwen/Qwen3.6-27B

Repository: Qwen/Qwen3.6-27B
Status: known
Link type: Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

hipfire

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source: https://www.localmaxxing.com/en/runs/cms8cugd000ezpf019okstvtr

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

./target/release/examples/dflash_spec_demo
--target
~/.hipfire/models/qwen3.6-27b-awq.mq4
--draft
~/.hipfire/models/qwen36-27b-dflash-mq4.hf4
--prompt-file
benchmarks/prompts/merge_sort_thinking_off.txt
--max
256
--temp
0.0
--no-chatml
--kv-mode
q8
--ctx
2048

Flag	Value
`--target`	`~/.hipfire/models/qwen3.6-27b-awq.mq4`
`--draft`	`~/.hipfire/models/qwen36-27b-dflash-mq4.hf4`
`--prompt-file`	`benchmarks/prompts/merge_sort_thinking_off.txt`
`--max`	`256`
`--temp`	`0.0`
`--kv-mode`	`q8`
`--ctx`	`2048`

Environment

Variable	Value
`HIPFIRE_HFQ4G256_LDSSTAGE`	`1`
`HIPFIRE_Q8_PREFILL_M4`	`0`
`HIP_VISIBLE_DEVICES`	`1`

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status	Sweep
1	2,048	158.6	112	290.2	observed	qwen3-6-27b-mq4-ryzen-ai-max-plus-395-128gb-hipfire-tp1-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count: 1
hardware id: ryzen-ai-max-plus-395-128gb
id: qwen3-6-27b-mq4-ryzen-ai-max-plus-395-128gb-hipfire-tp1
model instance id: qwen-qwen3-6-27b--mq4
recipe source: localmaxxing
schema version: local-ai-registry/v1
speed sweep ids: qwen3-6-27b-mq4-ryzen-ai-max-plus-395-128gb-hipfire-tp1-sweep
status: candidate

capabilities

engine

name: hipfire
version: 0.3.0+98d3567

serving

max context tokens: 2,048
tensor parallel: 1

Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.chat · reason capability-not-verified

capabilities.chat · state unknown

capabilities.reasoning · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.reasoning · reason capability-not-verified

capabilities.reasoning · state unknown

capabilities.tools · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.tools · reason capability-not-verified

capabilities.tools · state unknown

capabilities.vision · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.vision · reason capability-not-verified

capabilities.vision · state unknown

engine.graph mode · provenance · captured at: 2026-08-30T09:10:02Z

engine.graph mode · reason runtime-detail-not-published

engine.graph mode · state unknown

serving.kv cache tokens · provenance · captured at: 2026-08-30T09:10:02Z

serving.kv cache tokens · reason kv-cache-capacity-not-published

serving.kv cache tokens · state unknown

serving.max concurrency · provenance · captured at: 2026-08-31T23:03:15Z

serving.max concurrency · reason server-capacity-not-evidenced

serving.max concurrency · state unknown

metadata

localmaxxing · backend: rocm
localmaxxing · batch size: 1
localmaxxing · hardware label: Ryzen AI Max 395
localmaxxing · notes: Single client, single GPU, non-batched. NOT tensor-parallel, NOT pipeline-parallel, NOT a batched serve: one request at a time via the standalone dflash_spec_demo binary, not an HTTP server. Integrated Radeon 8060S (gfx1151, RDNA3.5) in a Ryzen AI MAX+ 395; the iGPU addresses 103.1 GB of the unified pool, ~30 GB remains to the host. Host also has 3 dGPUs; only the iGPU is used here. RDNA3.5 counterpart to our gfx1201 and gfx1100 entries. Pure DFlash speculative decode: 5-layer trained draft head, B=16, adaptive-B 8..16 settled at 16. No MTP, n-gram, prompt-lookup, tree or CASK. Greedy temp 0.0, deterministic. Every rep: tau=11.3846, accept_rate=0.7590, emitted=162, EOS reached. 5 fresh-process reps after one discarded JIT warmup, GPU-lock serialized, clocks untouched: 111.96/111.96/111.96/111.88/112.37 -> median 111.96, spread 0.44%. HIPFIRE_HFQ4G256_LDSSTAGE=1 (default off) is live on RDNA3.5 via the gfx11 sibling path: same-binary A/B gives 99.09 off (3 reps, 0.07% spread), i.e. +12.99% -- the largest of the three archs measured (+9.06% gfx1201, +10.60% gfx1100), consistent with staging trading DRAM traffic for LDS reuse on the most bandwidth-limited part. Routing verified: gemm_gate_up_hfq4g256_wmma_ldsstage.hsaco (17040 B) + gemm_hfq4g256_residual_wmma_ldsstage.hsaco (22288 B) under .hipfire_kernels/gfx1151/. HIPFIRE_Q8_PREFILL_M4=0 is gfx12-gated, inert here, set for command parity. NOT bit-exact by construction: LDS staging reorders f32 K-accumulation. Output still matched our gfx1201/gfx1100 runs byte-for-byte (md5 4d3a55e4), tau equal to 4 decimals across all three; one prompt at temp 0, not a quality result. Quantized artifact: schuttdev/hipfire-qwen3.6-27b @ f9b326a657f1 (qwen3.6-27b.mq4). Provenance: tree 98d3567e29500326cb0b6313b79648c9510b249e (beta); trunk sha256 86a5f80fd29d545a; draft md5 204c4c4c; prompt md5 253c7ac5; ROCm/HIP 7.14. peakVramGb = 17180 MiB per runtime.
localmaxxing · observed command: HIP_VISIBLE_DEVICES=1 HIPFIRE_HFQ4G256_LDSSTAGE=1 HIPFIRE_Q8_PREFILL_M4=0 ./target/release/examples/dflash_spec_demo --target ~/.hipfire/models/qwen3.6-27b-awq.mq4 --draft ~/.hipfire/models/qwen36-27b-dflash-mq4.hf4 --prompt-file benchmarks/prompts/merge_sort_thinking_off.txt --max 256 --temp 0.0 --no-chatml --kv-mode q8 --ctx 2048
localmaxxing · run id: cms8cugd000ezpf019okstvtr
localmaxxing · tokenized · arguments: ./target/release/examples/dflash_spec_demo, --target, ~/.hipfire/models/qwen3.6-27b-awq.mq4, --draft, ~/.hipfire/models/qwen36-27b-dflash-mq4.hf4, --prompt-file, benchmarks/prompts/merge_sort_thinking_off.txt, --max, 256, --temp, 0.0, --no-chatml, --kv-mode, q8, --ctx, 2048
localmaxxing · tokenized · environment · HIPFIRE HFQ4G256 LDSSTAGE: 1
localmaxxing · tokenized · environment · HIPFIRE Q8 PREFILL M4: 0
localmaxxing · tokenized · environment · HIP VISIBLE DEVICES: 1
localmaxxing · tokenized · fidelity: faithful

provenance

captured at: 2026-08-30T09:10:02Z

sources

captured at	kind	url
2026-08-30T09:10:02Z	normalized-recipe	www.localmaxxing.com/en/runs/cms8cugd000ezpf019okstvtr ↗