Recipe

qwen2-5-72b-q4-0-radeon-ai-pro-r9700-32gb-llama-cpp-tp3

qwen2-5-72b-q4-0-radeon-ai-pro-r9700-32gb-llama-cpp-tp3

JSON API Find compatible recipes

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status: candidate
Source: localmaxxing
Engine: llama.cpp
Engine version: b8974-5-g66bafdcf1
Accelerators: 3
Tensor parallel: 3
Context tokens: 131,072
Max concurrency: 1
chat: unknown
reasoning: unknown
tools: unknown
vision: unknown

Hugging Face model card

Identity

https://huggingface.co/moonshotai/Kimi-Dev-72B

Repository: moonshotai/Kimi-Dev-72B
Status: known
Link type: Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source: https://www.localmaxxing.com/en/runs/cmorr5jit0003jj04f3z7ti9t

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

/home/mikekey/Experiments/llama.cpp/build-vulkan/bin/llama-server
--port
${PORT}
--host
0.0.0.0
--no-webui
-ngl
99
--jinja
--cache-reuse
256
--parallel
2
-m
/home/mikekey/models/gguf/misc/Kimi-Dev-72B-Q4_0.gguf
--spec-draft-model
/home/mikekey/models/gguf/drafts/Qwen2.5-Coder-0.5B-Instruct-Q8_0.gguf
--spec-draft-n-max
8
--spec-draft-n-min
1
--spec-draft-p-min
0.7
--spec-draft-ngl
99
--temp
0.7
--top-p
0.8
--top-k
20
--repeat-penalty
1.05
-ctk
q8_0
-ctv
q8_0
--flash-attn
auto
-ts
1/1/1
-c
131072

Flag	Value
`--port`	`${PORT}`
`--host`	`0.0.0.0`
`-ngl`	`99`
`--cache-reuse`	`256`
`--parallel`	`2`
`-m`	`/home/mikekey/models/gguf/misc/Kimi-Dev-72B-Q4_0.gguf`
`--spec-draft-model`	`/home/mikekey/models/gguf/drafts/Qwen2.5-Coder-0.5B-Instruct-Q8_0.gguf`
`--spec-draft-n-max`	`8`
`--spec-draft-n-min`	`1`
`--spec-draft-p-min`	`0.7`
`--spec-draft-ngl`	`99`
`--temp`	`0.7`
`--top-p`	`0.8`
`--top-k`	`20`
`--repeat-penalty`	`1.05`
`-ctk`	`q8_0`
`-ctv`	`q8_0`
`--flash-attn`	`auto`
`-ts`	`1/1/1`
`-c`	`131072`

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status	Sweep
1	131,072	—	20.9	271.5	observed	qwen2-5-72b-q4-0-radeon-ai-pro-r9700-32gb-llama-cpp-tp3-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count: 3
hardware id: radeon-ai-pro-r9700-32gb
id: qwen2-5-72b-q4-0-radeon-ai-pro-r9700-32gb-llama-cpp-tp3
model instance id: moonshotai-kimi-dev-72b--q4-0
recipe source: localmaxxing
schema version: local-ai-registry/v1
speed sweep ids: qwen2-5-72b-q4-0-radeon-ai-pro-r9700-32gb-llama-cpp-tp3-sweep
status: candidate

capabilities

engine

name: llama.cpp
version: b8974-5-g66bafdcf1

serving

max concurrency: 1
max context tokens: 131,072
tensor parallel: 3

Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.chat · reason capability-not-verified

capabilities.chat · state unknown

capabilities.reasoning · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.reasoning · reason capability-not-verified

capabilities.reasoning · state unknown

capabilities.tools · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.tools · reason capability-not-verified

capabilities.tools · state unknown

capabilities.vision · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.vision · reason capability-not-verified

capabilities.vision · state unknown

engine.graph mode · provenance · captured at: 2026-08-30T09:10:02Z

engine.graph mode · reason runtime-detail-not-published

engine.graph mode · state unknown

serving.kv cache tokens · provenance · captured at: 2026-08-30T09:10:02Z

serving.kv cache tokens · reason kv-cache-capacity-not-published

serving.kv cache tokens · state unknown

metadata

localmaxxing · backend: vulkan
localmaxxing · hardware label: Radeon AI Pro R9700
localmaxxing · notes: Vulkan 3× R9700 + speculative decoding: Qwen2.5-Coder-0.5B-Instruct Q8_0 draft, --spec-draft-n-max 8 --spec-draft-p-min 0.7. Best of 3.
localmaxxing · observed command: /home/mikekey/Experiments/llama.cpp/build-vulkan/bin/llama-server --port ${PORT} --host 0.0.0.0 --no-webui -ngl 99 --jinja --cache-reuse 256 --parallel 2 -m /home/mikekey/models/gguf/misc/Kimi-Dev-72B-Q4_0.gguf --spec-draft-model /home/mikekey/models/gguf/drafts/Qwen2.5-Coder-0.5B-Instruct-Q8_0.gguf --spec-draft-n-max 8 --spec-draft-n-min 1 --spec-draft-p-min 0.7 --spec-draft-ngl 99 --temp 0.7 --top-p 0.8 --top-k 20 --repeat-penalty 1.05 -ctk q8_0 -ctv q8_0 --flash-attn auto -ts 1/1/1 -c 131072
localmaxxing · run id: cmorr5jit0003jj04f3z7ti9t
localmaxxing · tokenized · arguments: /home/mikekey/Experiments/llama.cpp/build-vulkan/bin/llama-server, --port, ${PORT}, --host, 0.0.0.0, --no-webui, -ngl, 99, --jinja, --cache-reuse, 256, --parallel, 2, -m, /home/mikekey/models/gguf/misc/Kimi-Dev-72B-Q4_0.gguf, --spec-draft-model, /home/mikekey/models/gguf/drafts/Qwen2.5-Coder-0.5B-Instruct-Q8_0.gguf, --spec-draft-n-max, 8, --spec-draft-n-min, 1, --spec-draft-p-min, 0.7, --spec-draft-ngl, 99, --temp, 0.7, --top-p, 0.8, --top-k, 20, --repeat-penalty, 1.05, -ctk, q8_0, -ctv, q8_0, --flash-attn, auto, -ts, 1/1/1, -c, 131072
localmaxxing · tokenized · fidelity: faithful

provenance

captured at: 2026-08-30T09:10:02Z

sources

captured at	kind	url
2026-08-30T09:10:02Z	normalized-recipe	www.localmaxxing.com/en/runs/cmorr5jit0003jj04f3z7ti9t ↗