Recipe

qwen3-6-27b-q4-k-m-rtx-4090-24gb-llama-cpp-tp1-jarmcutc

qwen3-6-27b-q4-k-m-rtx-4090-24gb-llama-cpp-tp1-jarmcutc

JSON API Find compatible recipes

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status: candidate
Source: localmaxxing
Engine: llama.cpp
Engine version: b8818-b572d1ecd
Accelerators: 1
Tensor parallel: 1
Context tokens: 90,200
Max concurrency: 2,048
chat: unknown
reasoning: unknown
tools: unknown
vision: unknown

Hugging Face model card

Identity

https://huggingface.co/Qwen/Qwen3.6-27B

Repository: Qwen/Qwen3.6-27B
Status: known
Link type: Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source: https://www.localmaxxing.com/en/runs/cmolvxd82000alb04jarmcutc

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

1. Launch
2. command:
1. llama-server
2. -m
3. Qwen3.6-27B-Q4_K_M.gguf
4. --host
5. 0.0.0.0
6. --port
7. 8080
8. -ngl
9. 99
10. -c
11. 90200
12. -b
13. 2048
14. -ub
15. 512
16. --flash-attn
17. on
18. --cache-type-k
19. q8_0
20. --cache-type-v
21. q8_0
22. -np
23. 1
24. --jinja
25. --no-mmap

Flag	Value
`-m`	`Qwen3.6-27B-Q4_K_M.gguf`
`--host`	`0.0.0.0`
`--port`	`8080`
`-ngl`	`99`
`-c`	`90200`
`-b`	`2048`
`-ub`	`512`
`--flash-attn`	`on`
`--cache-type-k`	`q8_0`
`--cache-type-v`	`q8_0`
`-np`	`1`

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status	Sweep
2048	90,200	—	46.6	409	observed	qwen3-6-27b-q4-k-m-rtx-4090-24gb-llama-cpp-tp1-jarmcutc-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count: 1
hardware id: rtx-4090-24gb
id: qwen3-6-27b-q4-k-m-rtx-4090-24gb-llama-cpp-tp1-jarmcutc
model instance id: qwen-qwen3-6-27b--q4-k-m
recipe source: localmaxxing
schema version: local-ai-registry/v1
speed sweep ids: qwen3-6-27b-q4-k-m-rtx-4090-24gb-llama-cpp-tp1-jarmcutc-sweep
status: candidate

capabilities

engine

name: llama.cpp
version: b8818-b572d1ecd

serving

max concurrency: 2,048
max context tokens: 90,200
tensor parallel: 1

Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.chat · reason capability-not-verified

capabilities.chat · state unknown

capabilities.reasoning · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.reasoning · reason capability-not-verified

capabilities.reasoning · state unknown

capabilities.tools · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.tools · reason capability-not-verified

capabilities.tools · state unknown

capabilities.vision · provenance · captured at: 2026-08-30T09:10:02Z

capabilities.vision · reason capability-not-verified

capabilities.vision · state unknown

engine.graph mode · provenance · captured at: 2026-08-30T09:10:02Z

engine.graph mode · reason runtime-detail-not-published

engine.graph mode · state unknown

serving.kv cache tokens · provenance · captured at: 2026-08-30T09:10:02Z

serving.kv cache tokens · reason kv-cache-capacity-not-published

serving.kv cache tokens · state unknown

metadata

localmaxxing · backend: cuda
localmaxxing · hardware label: RTX 4090
localmaxxing · notes: RTX 4090 24GB, WSL2, CUDA toolkit 12.8, Windows NVIDIA driver 591.59. llama.cpp build b8818-b572d1ecd, CUDA arch 89. Command used -ngl 99 -c 90200 -b 2048 -ub 512 --flash-attn on --cache-type-k q8_0 --cache-type-v q8_0 -np 1 --jinja --no-mmap. Model fully offloaded: 65/65 layers.
localmaxxing · observed command: Launch command: llama-server -m Qwen3.6-27B-Q4_K_M.gguf --host 0.0.0.0 --port 8080 -ngl 99 -c 90200 -b 2048 -ub 512 --flash-attn on --cache-type-k q8_0 --cache-type-v q8_0 -np 1 --jinja --no-mmap
localmaxxing · run id: cmolvxd82000alb04jarmcutc
localmaxxing · tokenized · arguments: llama-server, -m, Qwen3.6-27B-Q4_K_M.gguf, --host, 0.0.0.0, --port, 8080, -ngl, 99, -c, 90200, -b, 2048, -ub, 512, --flash-attn, on, --cache-type-k, q8_0, --cache-type-v, q8_0, -np, 1, --jinja, --no-mmap
localmaxxing · tokenized · fidelity: faithful

localmaxxing · tokenized · steps

0	1	2	3	4	5	6	7
Launch	command:	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown
llama-server	-m	Qwen3.6-27B-Q4_K_M.gguf	--host	0.0.0.0	--port	8080	-ngl

provenance

captured at: 2026-08-30T09:10:02Z

sources

captured at	kind	url
2026-08-30T09:10:02Z	normalized-recipe	www.localmaxxing.com/en/runs/cmolvxd82000alb04jarmcutc ↗