Recipe

qwen3-6-35b-a3b-iq4-xs-rx-7900-xtx-24gb-llama-cpp-tp1

qwen3-6-35b-a3b-iq4-xs-rx-7900-xtx-24gb-llama-cpp-tp1

JSON API Find compatible recipes

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status: candidate
Source: localmaxxing
Engine: llama.cpp
Accelerators: 1
Tensor parallel: 1
Max concurrency: 1
chat: unknown
reasoning: unknown
tools: unknown
vision: unknown

Hugging Face model card

Identity

https://huggingface.co/Qwen/Qwen3.6-35B-A3B

Repository: Qwen/Qwen3.6-35B-A3B
Status: known
Link type: Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source: https://www.localmaxxing.com/en/runs/cmolw295o000tju04uiwr820b

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

/app/llama.cpp/build/bin/llama-server
--models-dir
/models
--port
8001
--host
0.0.0.0
-ngl
99
--flash-attn
on
--cont-batching
--no-mmap
--threads
30
--cache-type-k
q4_0
--cache-type-v
q4_0
--mlock
--batch-size
4096
--ubatch-size
4096
--models-max
1
--parallel
1

Flag	Value
`--models-dir`	`/models`
`--port`	`8001`
`--host`	`0.0.0.0`
`-ngl`	`99`
`--flash-attn`	`on`
`--threads`	`30`
`--cache-type-k`	`q4_0`
`--cache-type-v`	`q4_0`
`--batch-size`	`4096`
`--ubatch-size`	`4096`
`--models-max`	`1`
`--parallel`	`1`

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status	Sweep
1	2,048	—	85.6	59	observed	qwen3-6-35b-a3b-iq4-xs-rx-7900-xtx-24gb-llama-cpp-tp1-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count: 1
hardware id: rx-7900-xtx-24gb
id: qwen3-6-35b-a3b-iq4-xs-rx-7900-xtx-24gb-llama-cpp-tp1
model instance id: qwen-qwen3-6-35b-a3b--iq4-xs
recipe source: localmaxxing
schema version: local-ai-registry/v1
speed sweep ids: qwen3-6-35b-a3b-iq4-xs-rx-7900-xtx-24gb-llama-cpp-tp1-sweep
status: candidate

capabilities

engine

name: llama.cpp

serving

max concurrency: 1
tensor parallel: 1

Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.chat · reason capability-not-verified

capabilities.chat · state unknown

capabilities.reasoning · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.reasoning · reason capability-not-verified

capabilities.reasoning · state unknown

capabilities.tools · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.tools · reason capability-not-verified

capabilities.tools · state unknown

capabilities.vision · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.vision · reason capability-not-verified

capabilities.vision · state unknown

engine.graph mode · provenance · captured at: 2026-08-30T09:10:02Z

engine.graph mode · reason runtime-detail-not-published

engine.graph mode · state unknown

serving.kv cache tokens · provenance · captured at: 2026-08-30T09:10:02Z

serving.kv cache tokens · reason kv-cache-capacity-not-published

serving.kv cache tokens · state unknown

serving.max concurrency · provenance · captured at: 2026-09-01T10:20:39Z

serving.max concurrency · reason explicit-source-server-capacity

serving.max concurrency · state known

serving.max context tokens · provenance · captured at: 2026-09-01T10:20:39Z

serving.max context tokens · reason context-limit-not-evidenced

serving.max context tokens · state unknown

metadata

localmaxxing · backend: rocm
localmaxxing · batch size: 4,096
localmaxxing · hardware label: RX 7900 XTX
localmaxxing · observed command: /app/llama.cpp/build/bin/llama-server --models-dir /models --port 8001 --host 0.0.0.0 -ngl 99 --flash-attn on --cont-batching --no-mmap --threads 30 --cache-type-k q4_0 --cache-type-v q4_0 --mlock --batch-size 4096 --ubatch-size 4096 --models-max 1 --parallel 1
localmaxxing · run id: cmolw295o000tju04uiwr820b
localmaxxing · tokenized · arguments: /app/llama.cpp/build/bin/llama-server, --models-dir, /models, --port, 8001, --host, 0.0.0.0, -ngl, 99, --flash-attn, on, --cont-batching, --no-mmap, --threads, 30, --cache-type-k, q4_0, --cache-type-v, q4_0, --mlock, --batch-size, 4096, --ubatch-size, 4096, --models-max, 1, --parallel, 1
localmaxxing · tokenized · fidelity: faithful

provenance

captured at: 2026-08-30T09:10:02Z

sources

captured at	kind	url
2026-08-30T09:10:02Z	normalized-recipe	www.localmaxxing.com/en/runs/cmolw295o000tju04uiwr820b ↗