Local AI Registry

Recipe

qwen3-8-27b-ud-q4-k-xl-rtx-4060-ti-16gb-llama-cpp-tp2

qwen3-8-27b-ud-q4-k-xl-rtx-4060-ti-16gb-llama-cpp-tp2
JSON APIFind compatible recipes

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status
candidate
Source
localmaxxing
Engine
llama.cpp
Accelerators
2
Tensor parallel
2
Context tokens
2,048
Max concurrency
1
chat
unknown
reasoning
unknown
tools
unknown
vision
unknown

Hugging Face model card

Identity

https://huggingface.co/unsloth/Qwen3.8-27B-GGUF
Repository
unsloth/Qwen3.8-27B-GGUF
Status
known
Link type
Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source
https://www.localmaxxing.com/en/runs/cmsvw7q4808esms0181bbixjc

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

    1. /app/llama-server
    2. --models-preset
    3. /presets/qwen38_models.ini
    4. --models-max
    5. 1
    6. --host
    7. 0.0.0.0
    8. --port
    9. 8001
    10. -lv
    11. 4
    1. hf-repo
    2. =
    3. unsloth/Qwen3.8-27B-GGUF
    1. hf-file
    2. =
    3. Qwen3.8-27B-UD-Q4_K_XL.gguf
    1. split-mode
    2. =
    3. tensor
    1. tensor-split
    2. =
    3. 1,1
    1. ctx-size
    2. =
    3. 150000
    1. spec-type
    2. =
    3. draft-mtp
    1. spec-draft-n-max
    2. =
    3. 3
    1. spec-ngram-mod-n-match
    2. =
    3. 24
    1. spec-ngram-mod-n-min
    2. =
    3. 48
    1. spec-ngram-mod-n-max
    2. =
    3. 64
    1. ctx-checkpoints
    2. =
    3. -1
    1. mmap
    2. =
    3. false
    1. flash-attn
    2. =
    3. on
    1. threads
    2. =
    3. 16
    1. parallel
    2. =
    3. 1
    1. batch-size
    2. =
    3. 2048
    1. ubatch-size
    2. =
    3. 1024
    1. jinja
    2. =
    3. true
    1. reasoning
    2. =
    3. on
    1. reasoning-budget
    2. =
    3. 1000
FlagValue
--models-preset/presets/qwen38_models.ini
--models-max1
--host0.0.0.0
--port8001
-lv4

Source notes

[A_Qwen3.8-27B-UD-Q4_K_XL-tensor-MTP3-ngram]

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatusSweep
12,048971.853.6—observedqwen3-8-27b-ud-q4-k-xl-rtx-4060-ti-16gb-llama-cpp-tp2-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count
2
hardware id
rtx-4060-ti-16gb
id
qwen3-8-27b-ud-q4-k-xl-rtx-4060-ti-16gb-llama-cpp-tp2
model instance id
unsloth-qwen3-8-27b-gguf--ud-q4-k-xl
recipe source
localmaxxing
schema version
local-ai-registry/v1
speed sweep ids
qwen3-8-27b-ud-q4-k-xl-rtx-4060-ti-16gb-llama-cpp-tp2-sweep
status
candidate

capabilities

engine

name
llama.cpp

serving

max concurrency
1
max context tokens
2,048
tensor parallel
2
Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at
2026-08-30T09:10:02Z
capabilities.chat · reason capability-not-verified
capabilities.chat · state unknown
capabilities.reasoning · provenance · captured at
2026-08-30T09:10:02Z
capabilities.reasoning · reason capability-not-verified
capabilities.reasoning · state unknown
capabilities.tools · provenance · captured at
2026-08-30T09:10:02Z
capabilities.tools · reason capability-not-verified
capabilities.tools · state unknown
capabilities.vision · provenance · captured at
2026-08-30T09:10:02Z
capabilities.vision · reason capability-not-verified
capabilities.vision · state unknown
engine.graph mode · provenance · captured at
2026-08-30T09:10:02Z
engine.graph mode · reason runtime-detail-not-published
engine.graph mode · state unknown
serving.kv cache tokens · provenance · captured at
2026-08-30T09:10:02Z
serving.kv cache tokens · reason kv-cache-capacity-not-published
serving.kv cache tokens · state unknown

metadata

localmaxxing · backend
cuda
localmaxxing · hardware label
RTX 4060 Ti
localmaxxing · notes
[43267] 6.56.997.443 I slot print_timing: id 0 | task 437 | prompt eval time = 5312.87 ms / 5163 tokens ( 1.03 ms per token, 971.79 tokens per second) [43267] 6.56.997.446 I slot print_timing: id 0 | task 437 | eval time = 355417.83 ms / 19064 tokens ( 18.64 ms per token, 53.64 tokens per second) [43267] 6.56.997.447 I slot print_timing: id 0 | task 437 | total time = 360730.70 ms / 24227 tokens [43267] 6.56.997.448 I slot print_timing: id 0 | task 437 | graphs reused = 6109 [43267] 6.56.997.451 I slot print_timing: id 0 | task 437 | draft acceptance = 0.76977 (13304 accepted / 17283 generated), mean len = 3.31
localmaxxing · run id
cmsvw7q4808esms0181bbixjc
localmaxxing · tokenized · fidelity
faithful
localmaxxing · tokenized · notes
[A_Qwen3.8-27B-UD-Q4_K_XL-tensor-MTP3-ngram]

localmaxxing · tokenized · steps

01234567
/app/llama-server--models-preset/presets/qwen38_models.ini--models-max1--host0.0.0.0--port
hf-repo=unsloth/Qwen3.8-27B-GGUFUnknownUnknownUnknownUnknownUnknown
hf-file=Qwen3.8-27B-UD-Q4_K_XL.ggufUnknownUnknownUnknownUnknownUnknown
split-mode=tensorUnknownUnknownUnknownUnknownUnknown
tensor-split=1,1UnknownUnknownUnknownUnknownUnknown
ctx-size=150000UnknownUnknownUnknownUnknownUnknown
spec-type=draft-mtpUnknownUnknownUnknownUnknownUnknown
spec-draft-n-max=3UnknownUnknownUnknownUnknownUnknown
spec-ngram-mod-n-match=24UnknownUnknownUnknownUnknownUnknown
spec-ngram-mod-n-min=48UnknownUnknownUnknownUnknownUnknown
spec-ngram-mod-n-max=64UnknownUnknownUnknownUnknownUnknown
ctx-checkpoints=-1UnknownUnknownUnknownUnknownUnknown
mmap=falseUnknownUnknownUnknownUnknownUnknown
flash-attn=onUnknownUnknownUnknownUnknownUnknown
threads=16UnknownUnknownUnknownUnknownUnknown
parallel=1UnknownUnknownUnknownUnknownUnknown
batch-size=2048UnknownUnknownUnknownUnknownUnknown
ubatch-size=1024UnknownUnknownUnknownUnknownUnknown
jinja=trueUnknownUnknownUnknownUnknownUnknown
reasoning=onUnknownUnknownUnknownUnknownUnknown
reasoning-budget=1000UnknownUnknownUnknownUnknownUnknown

provenance

captured at
2026-08-30T09:10:02Z

sources

captured atkindurl
2026-08-30T09:10:02Znormalized-recipewww.localmaxxing.com/en/runs/cmsvw7q4808esms0181bbixjc ↗