Local AI Registry

Recipe

qwen3-6-35b-a3b-q4-k-m-rtx-3090-24gb-llama-cpp-tp1

qwen3-6-35b-a3b-q4-k-m-rtx-3090-24gb-llama-cpp-tp1
JSON APIFind compatible recipes

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status
candidate
Source
localmaxxing
Engine
llama.cpp
Engine version
BeeLlama v0.3.2 (build 10251, commit 100fc138f)
Accelerators
1
Tensor parallel
1
Context tokens
131,072
Max concurrency
1
chat
unknown
reasoning
unknown
tools
unknown
vision
unknown

Hugging Face model card

Identity

https://huggingface.co/Jackrong/Qwopus3.6-35B-A3B-v1-MTP-GGUF
Repository
Jackrong/Qwopus3.6-35B-A3B-v1-MTP-GGUF
Status
known
Link type
Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source
https://www.localmaxxing.com/en/runs/cmqd27fdl00e4mp01bshz69ue

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

  1. llama-server
  2. -m
  3. Qwopus3.6-35B-A3B-v1-MTP-Q4_K_M.gguf
  4. --host
  5. 0.0.0.0
  6. --port
  7. 8080
  8. -ngl
  9. 99
  10. -c
  11. 131072
  12. -np
  13. 1
  14. -b
  15. 2048
  16. -ub
  17. 512
  18. -ctk
  19. kvarn6
  20. -ctv
  21. kvarn5
  22. -fa
  23. on
  24. --jinja
  25. --threads
  26. 16
  27. --no-webui
  28. --reasoning
  29. on
  30. --reasoning-budget
  31. 1024
  32. --reasoning-format
  33. deepseek
  34. --spec-type
  35. draft-mtp
  36. --spec-draft-n-max
  37. 2
FlagValue
-mQwopus3.6-35B-A3B-v1-MTP-Q4_K_M.gguf
--host0.0.0.0
--port8080
-ngl99
-c131072
-np1
-b2048
-ub512
-ctkkvarn6
-ctvkvarn5
-faon
--threads16
--reasoningon
--reasoning-budget1024
--reasoning-formatdeepseek
--spec-typedraft-mtp
--spec-draft-n-max2

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatusSweep
1131,0721,541167.930observedqwen3-6-35b-a3b-q4-k-m-rtx-3090-24gb-llama-cpp-tp1-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count
1
hardware id
rtx-3090-24gb
id
qwen3-6-35b-a3b-q4-k-m-rtx-3090-24gb-llama-cpp-tp1
model instance id
jackrong-qwopus3-6-35b-a3b-v1-mtp-gguf--q4-k-m
recipe source
localmaxxing
schema version
local-ai-registry/v1
speed sweep ids
qwen3-6-35b-a3b-q4-k-m-rtx-3090-24gb-llama-cpp-tp1-sweep
status
candidate

capabilities

draft launch

accelerator backend
nvidia
arguments
-hf, Jackrong/Qwopus3.6-35B-A3B-v1-MTP-GGUF:Q4_K_M, --n-gpu-layers, 999, --host, 0.0.0.0, --port, 8080, -c, 131072
container port
8,080
environment · LLAMA CACHE
/root/.cache/huggingface
host port
8,080
image
ghcr.io/ggml-org/llama.cpp:server-cuda12-b10481@sha256:b2497f8834f5ecb4e38530f6bf2734b8e0be107ff48e4720145911c86930f2ce
ipc
host
kind
docker
shm size
16g
synthesized · generated at
2026-08-31T22:12:17Z
synthesized · image provenance
gemma-4-12b-q4-k-m-rtx-3060-12gb-llama-cpp-tp1
synthesized · template
llama-cpp-server-v1

mounts

read onlytarget
No/root/.cache/huggingface

engine

name
llama.cpp
version
BeeLlama v0.3.2 (build 10251, commit 100fc138f)

serving

max concurrency
1
max context tokens
131,072
tensor parallel
1
Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at
2026-08-30T09:10:02Z
capabilities.chat · reason capability-not-verified
capabilities.chat · state unknown
capabilities.reasoning · provenance · captured at
2026-08-30T09:10:02Z
capabilities.reasoning · reason capability-not-verified
capabilities.reasoning · state unknown
capabilities.tools · provenance · captured at
2026-08-30T09:10:02Z
capabilities.tools · reason capability-not-verified
capabilities.tools · state unknown
capabilities.vision · provenance · captured at
2026-08-30T09:10:02Z
capabilities.vision · reason capability-not-verified
capabilities.vision · state unknown
draft launch.entrypoint · provenance · captured at
2026-09-01T01:41:26Z
draft launch.entrypoint · reason linux-amd64-container-config-entrypoint
draft launch.entrypoint · state known
engine.graph mode · provenance · captured at
2026-08-30T09:10:02Z
engine.graph mode · reason runtime-detail-not-published
engine.graph mode · state unknown
serving.kv cache tokens · provenance · captured at
2026-08-30T09:10:02Z
serving.kv cache tokens · reason kv-cache-capacity-not-published
serving.kv cache tokens · state unknown
serving.max concurrency · provenance · captured at
2026-08-31T23:03:15Z
serving.max concurrency · reason server-capacity-derived-from-source-evidence
serving.max concurrency · state known

metadata

localmaxxing · backend
cuda
localmaxxing · batch size
2,048
localmaxxing · hardware label
RTX 3090
localmaxxing · observed command
llama-server \ -m Qwopus3.6-35B-A3B-v1-MTP-Q4_K_M.gguf \ --host 0.0.0.0 --port 8080 \ -ngl 99 -c 131072 -np 1 \ -b 2048 -ub 512 \ -ctk kvarn6 -ctv kvarn5 \ -fa on \ --jinja --threads 16 --no-webui \ --reasoning on --reasoning-budget 1024 --reasoning-format deepseek \ --spec-type draft-mtp --spec-draft-n-max 2
localmaxxing · run id
cmqd27fdl00e4mp01bshz69ue
localmaxxing · tokenized · arguments
llama-server, -m, Qwopus3.6-35B-A3B-v1-MTP-Q4_K_M.gguf, --host, 0.0.0.0, --port, 8080, -ngl, 99, -c, 131072, -np, 1, -b, 2048, -ub, 512, -ctk, kvarn6, -ctv, kvarn5, -fa, on, --jinja, --threads, 16, --no-webui, --reasoning, on, --reasoning-budget, 1024, --reasoning-format, deepseek, --spec-type, draft-mtp, --spec-draft-n-max, 2
localmaxxing · tokenized · fidelity
faithful

provenance

captured at
2026-08-30T09:10:02Z

sources

captured atkindurl
2026-08-30T09:10:02Znormalized-recipewww.localmaxxing.com/en/runs/cmqd27fdl00e4mp01bshz69ue ↗