Recipe

kat-coder-v2-5-dev-q8-0-radeon-ai-pro-r9700-32gb-llama-cpp-tp3

kat-coder-v2-5-dev-q8-0-radeon-ai-pro-r9700-32gb-llama-cpp-tp3

JSON API Find compatible recipes

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status: candidate
Source: localmaxxing
Engine: llama.cpp
Engine version: b10107
Accelerators: 3
Tensor parallel: 3
Context tokens: 787
Max concurrency: 1
chat: unknown
reasoning: unknown
tools: unknown
vision: unknown

Hugging Face model card

Identity

https://huggingface.co/Kwaipilot/KAT-Coder-V2.5-Dev

Repository: Kwaipilot/KAT-Coder-V2.5-Dev
Status: known
Link type: Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source: https://www.localmaxxing.com/en/runs/cmsf8i7zs00tppp016vx3rrfp

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

/home/mikekey/Experiments/llama.cpp/build-vulkan/bin/llama-server
--port
${PORT}
--host
0.0.0.0
--no-webui
-ngl
99
--jinja
--flash-attn
auto
--cache-reuse
256
--prio
3
-m
/home/mikekey/models/gguf/misc/KAT-Coder-V2.5-Dev-Q8_0.gguf
--reasoning-format
auto
--temp
0.8
--top-p
0.9
--top-k
20
--presence-penalty
1.5
-ctk
f16
-ctv
f16
-ts
0/1/1
-np
1
-c
262144
--chat-template-kwargs
{"preserve_thinking": true}

Flag	Value
`--port`	`${PORT}`
`--host`	`0.0.0.0`
`-ngl`	`99`
`--flash-attn`	`auto`
`--cache-reuse`	`256`
`--prio`	`3`
`-m`	`/home/mikekey/models/gguf/misc/KAT-Coder-V2.5-Dev-Q8_0.gguf`
`--reasoning-format`	`auto`
`--temp`	`0.8`
`--top-p`	`0.9`
`--top-k`	`20`
`--presence-penalty`	`1.5`
`-ctk`	`f16`
`-ctv`	`f16`
`-ts`	`0/1/1`
`-np`	`1`
`-c`	`262144`
`--chat-template-kwargs`	`{"preserve_thinking": true}`

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status	Sweep
1	787	1,474.4	75.9	360.2	observed	kat-coder-v2-5-dev-q8-0-radeon-ai-pro-r9700-32gb-llama-cpp-tp3-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count: 3
hardware id: radeon-ai-pro-r9700-32gb
id: kat-coder-v2-5-dev-q8-0-radeon-ai-pro-r9700-32gb-llama-cpp-tp3
model instance id: kwaipilot-kat-coder-v2-5-dev--q8-0
recipe source: localmaxxing
schema version: local-ai-registry/v1
speed sweep ids: kat-coder-v2-5-dev-q8-0-radeon-ai-pro-r9700-32gb-llama-cpp-tp3-sweep
status: candidate

capabilities

engine

name: llama.cpp
version: b10107

serving

max concurrency: 1
max context tokens: 787
tensor parallel: 3

Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.chat · reason capability-not-verified

capabilities.chat · state unknown

capabilities.reasoning · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.reasoning · reason capability-not-verified

capabilities.reasoning · state unknown

capabilities.tools · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.tools · reason capability-not-verified

capabilities.tools · state unknown

capabilities.vision · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.vision · reason capability-not-verified

capabilities.vision · state unknown

engine.graph mode · provenance · captured at: 2026-08-30T09:10:02Z

engine.graph mode · reason runtime-detail-not-published

engine.graph mode · state unknown

serving.kv cache tokens · provenance · captured at: 2026-08-30T09:10:02Z

serving.kv cache tokens · reason kv-cache-capacity-not-published

serving.kv cache tokens · state unknown

serving.max concurrency · provenance · captured at: 2026-08-31T23:03:15Z

serving.max concurrency · reason server-capacity-derived-from-source-evidence

serving.max concurrency · state known

metadata

localmaxxing · backend: vulkan
localmaxxing · batch size: 1
localmaxxing · hardware label: Radeon AI Pro R9700
localmaxxing · notes: Automated sweep via llama-swap on 3x R9700. llama.cpp vulkan, best of 3 runs, cold prefill.
localmaxxing · observed command: /home/mikekey/Experiments/llama.cpp/build-vulkan/bin/llama-server --port ${PORT} --host 0.0.0.0 --no-webui -ngl 99 --jinja --flash-attn auto --cache-reuse 256 --prio 3 -m /home/mikekey/models/gguf/misc/KAT-Coder-V2.5-Dev-Q8_0.gguf --reasoning-format auto --temp 0.8 --top-p 0.9 --top-k 20 --presence-penalty 1.5 -ctk f16 -ctv f16 -ts 0/1/1 -np 1 -c 262144 --chat-template-kwargs '{"preserve_thinking": true}'
localmaxxing · run id: cmsf8i7zs00tppp016vx3rrfp
localmaxxing · tokenized · arguments: /home/mikekey/Experiments/llama.cpp/build-vulkan/bin/llama-server, --port, ${PORT}, --host, 0.0.0.0, --no-webui, -ngl, 99, --jinja, --flash-attn, auto, --cache-reuse, 256, --prio, 3, -m, /home/mikekey/models/gguf/misc/KAT-Coder-V2.5-Dev-Q8_0.gguf, --reasoning-format, auto, --temp, 0.8, --top-p, 0.9, --top-k, 20, --presence-penalty, 1.5, -ctk, f16, -ctv, f16, -ts, 0/1/1, -np, 1, -c, 262144, --chat-template-kwargs, {"preserve_thinking": true}
localmaxxing · tokenized · fidelity: faithful

provenance

captured at: 2026-08-30T09:10:02Z

sources

captured at	kind	url
2026-08-30T09:10:02Z	normalized-recipe	www.localmaxxing.com/en/runs/cmsf8i7zs00tppp016vx3rrfp ↗