Local AI Registry

Recipe

qwen3-6-27b-nvfp4-rtx-5090-32gb-llama-cpp-tp1

qwen3-6-27b-nvfp4-rtx-5090-32gb-llama-cpp-tp1
JSON APIFind compatible recipes

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status
candidate
Source
localmaxxing
Engine
llama.cpp
Accelerators
1
Tensor parallel
1
Context tokens
131,072
Max concurrency
1
chat
unknown
reasoning
unknown
tools
unknown
vision
unknown

Hugging Face model card

Identity

https://huggingface.co/nvidia/Qwen3.6-27B-NVFP4
Repository
nvidia/Qwen3.6-27B-NVFP4
Status
known
Link type
Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source
https://www.localmaxxing.com/en/runs/cmr2iwjvn06cspi01jphtk06h

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

  1. llama-server
  2. -m
  3. Qwen3.6-27B-NVFP4.gguf
  4. --host
  5. 0.0.0.0
  6. --port
  7. 8003
  8. -ngl
  9. 999
  10. -c
  11. 131072
  12. -fa
  13. on
  14. -ctk
  15. q8_0
  16. -ctv
  17. turbo4
  18. --jinja
  19. --chat-template-kwargs
  20. {enable_thinking:false}
  21. --reasoning
  22. off
  23. --reasoning-budget
  24. 0
  25. --no-mmap
  26. -b
  27. 4096
  28. -ub
  29. 512
  30. -np
  31. 1
FlagValue
-mQwen3.6-27B-NVFP4.gguf
--host0.0.0.0
--port8003
-ngl999
-c131072
-faon
-ctkq8_0
-ctvturbo4
--chat-template-kwargs{enable_thinking:false}
--reasoningoff
--reasoning-budget0
-b4096
-ub512
-np1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatusSweep
1131,0721,988.751.21,041.5observedqwen3-6-27b-nvfp4-rtx-5090-32gb-llama-cpp-tp1-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count
1
hardware id
rtx-5090-32gb
id
qwen3-6-27b-nvfp4-rtx-5090-32gb-llama-cpp-tp1
model instance id
nvidia-qwen3-6-27b-nvfp4--nvfp4
recipe source
localmaxxing
schema version
local-ai-registry/v1
speed sweep ids
qwen3-6-27b-nvfp4-rtx-5090-32gb-llama-cpp-tp1-sweep
status
candidate

capabilities

engine

name
llama.cpp

serving

max concurrency
1
max context tokens
131,072
tensor parallel
1
Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at
2026-08-30T09:10:02Z
capabilities.chat · reason capability-not-verified
capabilities.chat · state unknown
capabilities.reasoning · provenance · captured at
2026-08-30T09:10:02Z
capabilities.reasoning · reason capability-not-verified
capabilities.reasoning · state unknown
capabilities.tools · provenance · captured at
2026-08-30T09:10:02Z
capabilities.tools · reason capability-not-verified
capabilities.tools · state unknown
capabilities.vision · provenance · captured at
2026-08-30T09:10:02Z
capabilities.vision · reason capability-not-verified
capabilities.vision · state unknown
engine.graph mode · provenance · captured at
2026-08-30T09:10:02Z
engine.graph mode · reason runtime-detail-not-published
engine.graph mode · state unknown
serving.kv cache tokens · provenance · captured at
2026-08-30T09:10:02Z
serving.kv cache tokens · reason kv-cache-capacity-not-published
serving.kv cache tokens · state unknown
serving.max concurrency · provenance · captured at
2026-08-31T23:03:15Z
serving.max concurrency · reason server-capacity-derived-from-source-evidence
serving.max concurrency · state known

metadata

localmaxxing · backend
cuda
localmaxxing · batch size
1
localmaxxing · hardware label
RTX 5090
localmaxxing · notes
Automated import from local Hermes benchmark JSON hermes-benchmark-results-llamacpp-nvfp4/nvidia-Qwen3.6-27B-NVFP4-llamacpp-20260630-154200.json. Converted GGUF from local HF checkpoint. tokSOut/tokSPrefill are medians from matched prompts; TTFT is from the streaming case. Temperature 0 benchmark requests. Local filesystem paths redacted from commandSnippet.
localmaxxing · observed command
llama-server -m Qwen3.6-27B-NVFP4.gguf --host 0.0.0.0 --port 8003 -ngl 999 -c 131072 -fa on -ctk q8_0 -ctv turbo4 --jinja --chat-template-kwargs {enable_thinking:false} --reasoning off --reasoning-budget 0 --no-mmap -b 4096 -ub 512 -np 1
localmaxxing · run id
cmr2iwjvn06cspi01jphtk06h
localmaxxing · tokenized · arguments
llama-server, -m, Qwen3.6-27B-NVFP4.gguf, --host, 0.0.0.0, --port, 8003, -ngl, 999, -c, 131072, -fa, on, -ctk, q8_0, -ctv, turbo4, --jinja, --chat-template-kwargs, {enable_thinking:false}, --reasoning, off, --reasoning-budget, 0, --no-mmap, -b, 4096, -ub, 512, -np, 1
localmaxxing · tokenized · fidelity
faithful

provenance

captured at
2026-08-30T09:10:02Z

sources

captured atkindurl
2026-08-30T09:10:02Znormalized-recipewww.localmaxxing.com/en/runs/cmr2iwjvn06cspi01jphtk06h ↗