Recipe

qwen3-6-35b-a3b-q4-k-m-radeon-ai-pro-r9700-32gb-llama-cpp-tp3

qwen3-6-35b-a3b-q4-k-m-radeon-ai-pro-r9700-32gb-llama-cpp-tp3

JSON API Find compatible recipes

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status: candidate
Source: localmaxxing
Engine: llama.cpp
Engine version: b10106-1-g779d20bdc
Accelerators: 3
Tensor parallel: 3
Context tokens: 787
Max concurrency: 1
chat: unknown
reasoning: unknown
tools: unknown
vision: unknown

Hugging Face model card

Identity

https://huggingface.co/Qwen/Qwen3.6-35B-A3B

Repository: Qwen/Qwen3.6-35B-A3B
Status: known
Link type: Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source: https://www.localmaxxing.com/en/runs/cmsnfwn9m00d8o001elsb3flc

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

/home/mikekey/.config/llama-swap/gpu-order.sh
exec
/home/mikekey/Experiments/llama.cpp/build-vulkan/bin/llama-server
--port
${PORT}
--host
0.0.0.0
--no-webui
-ngl
99
--jinja
--flash-attn
auto
--cache-reuse
256
--prio
3
-m
/home/mikekey/models/Qwen3.6-35B-A3B-Q4_K_M.gguf
--reasoning-format
auto
--temp
0.6
--top-p
0.95
--top-k
20
--min-p
0.0
--presence-penalty
0.00
--repeat-penalty
1.0
-ctk
f16
-ctv
f16
-ts
1/1/0
-np
1
-c
262144
--chat-template-kwargs
{"preserve_thinking": true}

Flag	Value
`--port`	`${PORT}`
`--host`	`0.0.0.0`
`-ngl`	`99`
`--flash-attn`	`auto`
`--cache-reuse`	`256`
`--prio`	`3`
`-m`	`/home/mikekey/models/Qwen3.6-35B-A3B-Q4_K_M.gguf`
`--reasoning-format`	`auto`
`--temp`	`0.6`
`--top-p`	`0.95`
`--top-k`	`20`
`--min-p`	`0.0`
`--presence-penalty`	`0.00`
`--repeat-penalty`	`1.0`
`-ctk`	`f16`
`-ctv`	`f16`
`-ts`	`1/1/0`
`-np`	`1`
`-c`	`262144`
`--chat-template-kwargs`	`{"preserve_thinking": true}`

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status	Sweep
1	787	1,517	91	350	observed	qwen3-6-35b-a3b-q4-k-m-radeon-ai-pro-r9700-32gb-llama-cpp-tp3-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count: 3
hardware id: radeon-ai-pro-r9700-32gb
id: qwen3-6-35b-a3b-q4-k-m-radeon-ai-pro-r9700-32gb-llama-cpp-tp3
model instance id: qwen-qwen3-6-35b-a3b--q4-k-m
recipe source: localmaxxing
schema version: local-ai-registry/v1
speed sweep ids: qwen3-6-35b-a3b-q4-k-m-radeon-ai-pro-r9700-32gb-llama-cpp-tp3-sweep
status: candidate

capabilities

engine

name: llama.cpp
version: b10106-1-g779d20bdc

serving

max concurrency: 1
max context tokens: 787
tensor parallel: 3

Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.chat · reason capability-not-verified

capabilities.chat · state unknown

capabilities.reasoning · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.reasoning · reason capability-not-verified

capabilities.reasoning · state unknown

capabilities.tools · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.tools · reason capability-not-verified

capabilities.tools · state unknown

capabilities.vision · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.vision · reason capability-not-verified

capabilities.vision · state unknown

engine.graph mode · provenance · captured at: 2026-08-30T09:10:02Z

engine.graph mode · reason runtime-detail-not-published

engine.graph mode · state unknown

serving.kv cache tokens · provenance · captured at: 2026-08-30T09:10:02Z

serving.kv cache tokens · reason kv-cache-capacity-not-published

serving.kv cache tokens · state unknown

serving.max concurrency · provenance · captured at: 2026-08-31T23:03:15Z

serving.max concurrency · reason server-capacity-derived-from-source-evidence

serving.max concurrency · state known

metadata

localmaxxing · backend: vulkan
localmaxxing · batch size: 1
localmaxxing · hardware label: Radeon AI Pro R9700
localmaxxing · notes: llama.cpp Vulkan on 3× R9700 via llama-swap. Best of 3 runs.
localmaxxing · observed command: /home/mikekey/.config/llama-swap/gpu-order.sh exec /home/mikekey/Experiments/llama.cpp/build-vulkan/bin/llama-server --port ${PORT} --host 0.0.0.0 --no-webui -ngl 99 --jinja --flash-attn auto --cache-reuse 256 --prio 3 -m /home/mikekey/models/Qwen3.6-35B-A3B-Q4_K_M.gguf --reasoning-format auto --temp 0.6 --top-p 0.95 --top-k 20 --min-p 0.0 --presence-penalty 0.00 --repeat-penalty 1.0 -ctk f16 -ctv f16 -ts 1/1/0 -np 1 -c 262144 --chat-template-kwargs '{"preserve_thinking": true}'
localmaxxing · run id: cmsnfwn9m00d8o001elsb3flc
localmaxxing · tokenized · arguments: /home/mikekey/.config/llama-swap/gpu-order.sh, exec, /home/mikekey/Experiments/llama.cpp/build-vulkan/bin/llama-server, --port, ${PORT}, --host, 0.0.0.0, --no-webui, -ngl, 99, --jinja, --flash-attn, auto, --cache-reuse, 256, --prio, 3, -m, /home/mikekey/models/Qwen3.6-35B-A3B-Q4_K_M.gguf, --reasoning-format, auto, --temp, 0.6, --top-p, 0.95, --top-k, 20, --min-p, 0.0, --presence-penalty, 0.00, --repeat-penalty, 1.0, -ctk, f16, -ctv, f16, -ts, 1/1/0, -np, 1, -c, 262144, --chat-template-kwargs, {"preserve_thinking": true}
localmaxxing · tokenized · fidelity: faithful

provenance

captured at: 2026-08-30T09:10:02Z

sources

captured at	kind	url
2026-08-30T09:10:02Z	normalized-recipe	www.localmaxxing.com/en/runs/cmsnfwn9m00d8o001elsb3flc ↗