Local AI Registry

Recipe

qwen3-8-27b-ud-q4-k-xl-rtx-4090-24gb-llama-cpp-tp1

qwen3-8-27b-ud-q4-k-xl-rtx-4090-24gb-llama-cpp-tp1
JSON APIFind compatible recipes

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status
candidate
Source
localmaxxing
Engine
llama.cpp
Engine version
llama.cpp 7e4c0a96880dae4fc4268ad441f8a6446bd5460a (build 4)
Accelerators
1
Tensor parallel
1
Context tokens
172,032
Max concurrency
128
chat
unknown
reasoning
unknown
tools
unknown
vision
unknown

Hugging Face model card

Identity

https://huggingface.co/unsloth/Qwen3.8-27B-GGUF
Repository
unsloth/Qwen3.8-27B-GGUF
Status
known
Link type
Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source
https://www.localmaxxing.com/en/runs/cmszmr4d20e79ms01wkwh7v9b

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

  1. llama-server
  2. -m
  3. Qwen3.8-27B-UD-Q4_K_XL.gguf
  4. -ngl
  5. 999
  6. -c
  7. 172032
  8. -fa
  9. on
  10. --cache-type-k
  11. q8_0
  12. --cache-type-v
  13. q4_0
  14. --jinja
  15. -rea
  16. on
  17. --reasoning-format
  18. deepseek
  19. -np
  20. 1
  21. -b
  22. 128
  23. -ub
  24. 64
  25. --no-warmup
  26. --device
  27. CUDA0
  28. --split-mode
  29. none
  30. --spec-type
  31. draft-mtp
  32. --spec-draft-n-max
  33. 6
  34. --spec-draft-p-min
  35. 0.75
FlagValue
-mQwen3.8-27B-UD-Q4_K_XL.gguf
-ngl999
-c172032
-faon
--cache-type-kq8_0
--cache-type-vq4_0
-reaon
--reasoning-formatdeepseek
-np1
-b128
-ub64
--deviceCUDA0
--split-modenone
--spec-typedraft-mtp
--spec-draft-n-max6
--spec-draft-p-min0.75

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatusSweep
128172,032968.591.6—observedqwen3-8-27b-ud-q4-k-xl-rtx-4090-24gb-llama-cpp-tp1-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count
1
hardware id
rtx-4090-24gb
id
qwen3-8-27b-ud-q4-k-xl-rtx-4090-24gb-llama-cpp-tp1
model instance id
unsloth-qwen3-8-27b-gguf--ud-q4-k-xl
recipe source
localmaxxing
schema version
local-ai-registry/v1
speed sweep ids
qwen3-8-27b-ud-q4-k-xl-rtx-4090-24gb-llama-cpp-tp1-sweep
status
candidate

capabilities

draft launch

accelerator backend
nvidia
arguments
-hf, unsloth/Qwen3.8-27B-GGUF, --n-gpu-layers, 999, --host, 0.0.0.0, --port, 8080, -c, 172032
container port
8,080
environment · LLAMA CACHE
/root/.cache/huggingface
host port
8,080
image
ghcr.io/ggml-org/llama.cpp:server-cuda12-b10481@sha256:b2497f8834f5ecb4e38530f6bf2734b8e0be107f0f0857e259672d1cb85b71c2
ipc
host
kind
docker
shm size
16g
synthesized · generated at
2026-08-31T22:12:17Z
synthesized · image provenance
gemma-4-12b-q4-k-m-rtx-3060-12gb-llama-cpp-tp1
synthesized · template
llama-cpp-server-v1

mounts

read onlytarget
No/root/.cache/huggingface

engine

name
llama.cpp
version
llama.cpp 7e4c0a96880dae4fc4268ad441f8a6446bd5460a (build 4)

serving

max concurrency
128
max context tokens
172,032
tensor parallel
1
Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at
2026-08-30T09:10:02Z
capabilities.chat · reason capability-not-verified
capabilities.chat · state unknown
capabilities.reasoning · provenance · captured at
2026-08-30T09:10:02Z
capabilities.reasoning · reason capability-not-verified
capabilities.reasoning · state unknown
capabilities.tools · provenance · captured at
2026-08-30T09:10:02Z
capabilities.tools · reason capability-not-verified
capabilities.tools · state unknown
capabilities.vision · provenance · captured at
2026-08-30T09:10:02Z
capabilities.vision · reason capability-not-verified
capabilities.vision · state unknown
engine.graph mode · provenance · captured at
2026-08-30T09:10:02Z
engine.graph mode · reason runtime-detail-not-published
engine.graph mode · state unknown
serving.kv cache tokens · provenance · captured at
2026-08-30T09:10:02Z
serving.kv cache tokens · reason kv-cache-capacity-not-published
serving.kv cache tokens · state unknown

metadata

localmaxxing · backend
cuda
localmaxxing · hardware label
RTX 4090
localmaxxing · notes
Single near-ceiling cold-prompt plus forced long-generation production-composition stress. Exact 16,384-token output completed; MTP accepted 14,028/14,065 drafts (99.73694%); no service restart or CUDA/OOM/Xid fault. Q8 K / Q4 V cache. No vision projector was loaded for this run.
localmaxxing · observed command
llama-server -m Qwen3.8-27B-UD-Q4_K_XL.gguf -ngl 999 -c 172032 -fa on --cache-type-k q8_0 --cache-type-v q4_0 --jinja -rea on --reasoning-format deepseek -np 1 -b 128 -ub 64 --no-warmup --device CUDA0 --split-mode none --spec-type draft-mtp --spec-draft-n-max 6 --spec-draft-p-min 0.75
localmaxxing · run id
cmszmr4d20e79ms01wkwh7v9b
localmaxxing · tokenized · arguments
llama-server, -m, Qwen3.8-27B-UD-Q4_K_XL.gguf, -ngl, 999, -c, 172032, -fa, on, --cache-type-k, q8_0, --cache-type-v, q4_0, --jinja, -rea, on, --reasoning-format, deepseek, -np, 1, -b, 128, -ub, 64, --no-warmup, --device, CUDA0, --split-mode, none, --spec-type, draft-mtp, --spec-draft-n-max, 6, --spec-draft-p-min, 0.75
localmaxxing · tokenized · fidelity
faithful

provenance

captured at
2026-08-30T09:10:02Z

sources

captured atkindurl
2026-08-30T09:10:02Znormalized-recipewww.localmaxxing.com/en/runs/cmszmr4d20e79ms01wkwh7v9b ↗