Local AI Registry

Recipe

qwen3-coder-30b-a3b-instruct-q4-k-m-rx-7900-xtx-24gb-llama-cpp-tp1-g4ytl79y

qwen3-coder-30b-a3b-instruct-q4-k-m-rx-7900-xtx-24gb-llama-cpp-tp1-g4ytl79y
JSON APIFind compatible recipes

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status
candidate
Source
localmaxxing
Engine
llama.cpp
Engine version
LM Studio ROCm bundle 2.24.0
Accelerators
1
Tensor parallel
1
Context tokens
2,048
Max concurrency
1
chat
unknown
reasoning
unknown
tools
unknown
vision
unknown

Hugging Face model card

Identity

https://huggingface.co/Qwen/Qwen3-Coder-30B-A3B-Instruct
Repository
Qwen/Qwen3-Coder-30B-A3B-Instruct
Status
known
Link type
Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source
https://www.localmaxxing.com/en/runs/cmrlfrnz60bw6mj01g4ytl79y

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

  1. llama-server
  2. --model
  3. lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-GGUF/Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf
  4. --no-webui
  5. --jinja
  6. --ctx-size
  7. 262144
  8. --n-gpu-layers
  9. 999999
  10. --n-cpu-moe
  11. 0
  12. --main-gpu
  13. 0
  14. --tensor-split
  15. 0
  16. --split-mode
  17. layer
  18. --batch-size
  19. 2048
  20. --ubatch-size
  21. 512
  22. --threads
  23. 6
  24. --parallel
  25. 1
  26. --cache-type-k
  27. q8_0
  28. --cache-type-v
  29. q8_0
  30. --flash-attn
  31. on
  32. --kv-offload
  33. --kv-unified
  34. --no-direct-io
  35. --mlock
FlagValue
--modellmstudio-community/Qwen3-Coder-30B-A3B-Instruct-GGUF/Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf
--ctx-size262144
--n-gpu-layers999999
--n-cpu-moe0
--main-gpu0
--tensor-split0
--split-modelayer
--batch-size2048
--ubatch-size512
--threads6
--parallel1
--cache-type-kq8_0
--cache-type-vq8_0
--flash-attnon

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatusSweep
12,04823043.82,116observedqwen3-coder-30b-a3b-instruct-q4-k-m-rx-7900-xtx-24gb-llama-cpp-tp1-g4ytl79y-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count
1
hardware id
rx-7900-xtx-24gb
id
qwen3-coder-30b-a3b-instruct-q4-k-m-rx-7900-xtx-24gb-llama-cpp-tp1-g4ytl79y
model instance id
qwen-qwen3-coder-30b-a3b-instruct--q4-k-m
recipe source
localmaxxing
schema version
local-ai-registry/v1
speed sweep ids
qwen3-coder-30b-a3b-instruct-q4-k-m-rx-7900-xtx-24gb-llama-cpp-tp1-g4ytl79y-sweep
status
candidate

capabilities

engine

name
llama.cpp
version
LM Studio ROCm bundle 2.24.0

serving

max concurrency
1
max context tokens
2,048
tensor parallel
1
Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at
2026-08-30T09:10:02Z
capabilities.chat · reason capability-not-verified
capabilities.chat · state unknown
capabilities.reasoning · provenance · captured at
2026-08-30T09:10:02Z
capabilities.reasoning · reason capability-not-verified
capabilities.reasoning · state unknown
capabilities.tools · provenance · captured at
2026-08-30T09:10:02Z
capabilities.tools · reason capability-not-verified
capabilities.tools · state unknown
capabilities.vision · provenance · captured at
2026-08-30T09:10:02Z
capabilities.vision · reason capability-not-verified
capabilities.vision · state unknown
engine.graph mode · provenance · captured at
2026-08-30T09:10:02Z
engine.graph mode · reason runtime-detail-not-published
engine.graph mode · state unknown
serving.kv cache tokens · provenance · captured at
2026-08-30T09:10:02Z
serving.kv cache tokens · reason kv-cache-capacity-not-published
serving.kv cache tokens · state unknown

metadata

localmaxxing · backend
rocm
localmaxxing · hardware label
RX 7900 XTX
localmaxxing · observed command
llama-server --model lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-GGUF/Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf --no-webui --jinja --ctx-size 262144 --n-gpu-layers 999999 --n-cpu-moe 0 --main-gpu 0 --tensor-split 0 --split-mode layer --batch-size 2048 --ubatch-size 512 --threads 6 --parallel 1 --cache-type-k q8_0 --cache-type-v q8_0 --flash-attn on --kv-offload --kv-unified --no-direct-io --mlock
localmaxxing · run id
cmrlfrnz60bw6mj01g4ytl79y
localmaxxing · tokenized · arguments
llama-server, --model, lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-GGUF/Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf, --no-webui, --jinja, --ctx-size, 262144, --n-gpu-layers, 999999, --n-cpu-moe, 0, --main-gpu, 0, --tensor-split, 0, --split-mode, layer, --batch-size, 2048, --ubatch-size, 512, --threads, 6, --parallel, 1, --cache-type-k, q8_0, --cache-type-v, q8_0, --flash-attn, on, --kv-offload, --kv-unified, --no-direct-io, --mlock
localmaxxing · tokenized · fidelity
faithful

provenance

captured at
2026-08-30T09:10:02Z

sources

captured atkindurl
2026-08-30T09:10:02Znormalized-recipewww.localmaxxing.com/en/runs/cmrlfrnz60bw6mj01g4ytl79y ↗