Local AI Registry

Recipe

muse-glimmer-30b-ud-q6-k-xl-rtx-4060-ti-16gb-llama-cpp-tp2

muse-glimmer-30b-ud-q6-k-xl-rtx-4060-ti-16gb-llama-cpp-tp2
JSON APIFind compatible recipes

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status
candidate
Source
localmaxxing
Engine
llama.cpp
Accelerators
2
Tensor parallel
2
Context tokens
125,000
Max concurrency
1
chat
unknown
reasoning
unknown
tools
unknown
vision
unknown

Hugging Face model card

Identity

https://huggingface.co/unsloth/Muse-Glimmer-30B-GGUF
Repository
unsloth/Muse-Glimmer-30B-GGUF
Status
known
Link type
Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source
https://www.localmaxxing.com/en/runs/cmsvyj92g08g4ms011m4f9hpw

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

    1. /app/llama-server
    2. --models-preset
    3. /presets/glimmer_models.ini
    4. --models-max
    5. 1
    6. --host
    7. 0.0.0.0
    8. --port
    9. 8001
    10. -lv
    11. 4
    1. hf-repo
    2. =
    3. unsloth/Muse-Glimmer-30B-GGUF
    1. hf-file
    2. =
    3. Muse-Glimmer-30B-UD-Q6_K_XL.gguf
    1. spec-draft-model
    2. =
    3. /root/.cache/huggingface/hub/models--unsloth--Muse-Glimmer-30B-GGUF/snapshots/faa5b025c584459c13febfa5c59883516710ae39/dflash-kquant.gguf
    1. split-mode
    2. =
    3. tensor
    1. tensor-split
    2. =
    3. 1,1
    1. ctx-size
    2. =
    3. 125000
    1. spec-type
    2. =
    3. draft-dflash
    1. spec-draft-n-max
    2. =
    3. 4
    1. temperature
    2. =
    3. 1.0
    1. top-p
    2. =
    3. 0.95
    1. top-k
    2. =
    3. 64
    1. load-mode
    2. =
    3. mmap
    1. flash-attn
    2. =
    3. on
    1. parallel
    2. =
    3. 1
    1. jinja
    2. =
    3. true
    1. reasoning
    2. =
    3. on
    1. reasoning-budget
    2. =
    3. 1000
FlagValue
--models-preset/presets/glimmer_models.ini
--models-max1
--host0.0.0.0
--port8001
-lv4

Source notes

[A-glimmer-30b-2gpu]

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatusSweep
1125,000841.244—observedmuse-glimmer-30b-ud-q6-k-xl-rtx-4060-ti-16gb-llama-cpp-tp2-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count
2
hardware id
rtx-4060-ti-16gb
id
muse-glimmer-30b-ud-q6-k-xl-rtx-4060-ti-16gb-llama-cpp-tp2
model instance id
unsloth-muse-glimmer-30b-gguf--ud-q6-k-xl
recipe source
localmaxxing
schema version
local-ai-registry/v1
speed sweep ids
muse-glimmer-30b-ud-q6-k-xl-rtx-4060-ti-16gb-llama-cpp-tp2-sweep
status
candidate

capabilities

engine

name
llama.cpp

serving

max concurrency
1
max context tokens
125,000
tensor parallel
2
Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at
2026-08-30T09:10:02Z
capabilities.chat · reason capability-not-verified
capabilities.chat · state unknown
capabilities.reasoning · provenance · captured at
2026-08-30T09:10:02Z
capabilities.reasoning · reason capability-not-verified
capabilities.reasoning · state unknown
capabilities.tools · provenance · captured at
2026-08-30T09:10:02Z
capabilities.tools · reason capability-not-verified
capabilities.tools · state unknown
capabilities.vision · provenance · captured at
2026-08-30T09:10:02Z
capabilities.vision · reason capability-not-verified
capabilities.vision · state unknown
engine.graph mode · provenance · captured at
2026-08-30T09:10:02Z
engine.graph mode · reason runtime-detail-not-published
engine.graph mode · state unknown
serving.kv cache tokens · provenance · captured at
2026-08-30T09:10:02Z
serving.kv cache tokens · reason kv-cache-capacity-not-published
serving.kv cache tokens · state unknown

metadata

localmaxxing · backend
cuda
localmaxxing · hardware label
RTX 4060 Ti
localmaxxing · run id
cmsvyj92g08g4ms011m4f9hpw
localmaxxing · tokenized · fidelity
faithful
localmaxxing · tokenized · notes
[A-glimmer-30b-2gpu]

localmaxxing · tokenized · steps

01234567
/app/llama-server--models-preset/presets/glimmer_models.ini--models-max1--host0.0.0.0--port
hf-repo=unsloth/Muse-Glimmer-30B-GGUFUnknownUnknownUnknownUnknownUnknown
hf-file=Muse-Glimmer-30B-UD-Q6_K_XL.ggufUnknownUnknownUnknownUnknownUnknown
spec-draft-model=/root/.cache/huggingface/hub/models--unsloth--Muse-Glimmer-30B-GGUF/snapshots/faa5b025c584459c13febfa5c59883516710ae39/dflash-kquant.ggufUnknownUnknownUnknownUnknownUnknown
split-mode=tensorUnknownUnknownUnknownUnknownUnknown
tensor-split=1,1UnknownUnknownUnknownUnknownUnknown
ctx-size=125000UnknownUnknownUnknownUnknownUnknown
spec-type=draft-dflashUnknownUnknownUnknownUnknownUnknown
spec-draft-n-max=4UnknownUnknownUnknownUnknownUnknown
temperature=1.0UnknownUnknownUnknownUnknownUnknown
top-p=0.95UnknownUnknownUnknownUnknownUnknown
top-k=64UnknownUnknownUnknownUnknownUnknown
load-mode=mmapUnknownUnknownUnknownUnknownUnknown
flash-attn=onUnknownUnknownUnknownUnknownUnknown
parallel=1UnknownUnknownUnknownUnknownUnknown
jinja=trueUnknownUnknownUnknownUnknownUnknown
reasoning=onUnknownUnknownUnknownUnknownUnknown
reasoning-budget=1000UnknownUnknownUnknownUnknownUnknown

provenance

captured at
2026-08-30T09:10:02Z

sources

captured atkindurl
2026-08-30T09:10:02Znormalized-recipewww.localmaxxing.com/en/runs/cmsvyj92g08g4ms011m4f9hpw ↗