Local AI Registry

Recipe

glm-5-2-ud-q2-k-mxfp4-rtx-pro-6000-blackwell-96gb-llama-cpp-tp4

glm-5-2-ud-q2-k-mxfp4-rtx-pro-6000-blackwell-96gb-llama-cpp-tp4
JSON APIFind compatible recipes

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status
candidate
Source
localmaxxing
Engine
llama.cpp
Engine version
9445 (af6528e6d)
Accelerators
4
Tensor parallel
4
Context tokens
524,288
Max concurrency
1
chat
unknown
reasoning
unknown
tools
unknown
vision
unknown

Hugging Face model card

Identity

https://huggingface.co/huihui-ai/Huihui-GLM-5.2-abliterated-GGUF
Repository
huihui-ai/Huihui-GLM-5.2-abliterated-GGUF
Status
known
Link type
Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source
https://www.localmaxxing.com/en/runs/cms8lztrn0011pm01khyyqij8

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

  1. llama-server
  2. --model
  3. GLM-5.2-UD-Q2_K_MXFP4-00001-of-00007.gguf
  4. --alias
  5. GLM-5.2
  6. --ctx-size
  7. 524288
  8. --parallel
  9. 1
  10. --threads
  11. 32
  12. --threads-batch
  13. 32
  14. --batch-size
  15. 2048
  16. --ubatch-size
  17. 512
  18. --gpu-layers
  19. auto
  20. --split-mode
  21. layer
  22. --fit
  23. on
  24. --fit-target
  25. 4096
  26. --fit-ctx
  27. 32768
  28. --flash-attn
  29. auto
  30. --cache-type-k
  31. q8_0
  32. --cache-type-v
  33. q8_0
  34. --jinja
  35. --reasoning
  36. auto
  37. --reasoning-format
  38. deepseek
  39. --cont-batching
FlagValue
--modelGLM-5.2-UD-Q2_K_MXFP4-00001-of-00007.gguf
--aliasGLM-5.2
--ctx-size524288
--parallel1
--threads32
--threads-batch32
--batch-size2048
--ubatch-size512
--gpu-layersauto
--split-modelayer
--fiton
--fit-target4096
--fit-ctx32768
--flash-attnauto
--cache-type-kq8_0
--cache-type-vq8_0
--reasoningauto
--reasoning-formatdeepseek

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatusSweep
1524,288—47.935.3observedglm-5-2-ud-q2-k-mxfp4-rtx-pro-6000-blackwell-96gb-llama-cpp-tp4-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count
4
hardware id
rtx-pro-6000-blackwell-96gb
id
glm-5-2-ud-q2-k-mxfp4-rtx-pro-6000-blackwell-96gb-llama-cpp-tp4
model instance id
huihui-ai-huihui-glm-5-2-abliterated-gguf--ud-q2-k-mxfp4
recipe source
localmaxxing
schema version
local-ai-registry/v1
speed sweep ids
glm-5-2-ud-q2-k-mxfp4-rtx-pro-6000-blackwell-96gb-llama-cpp-tp4-sweep
status
candidate

capabilities

engine

name
llama.cpp
version
9445 (af6528e6d)

serving

max concurrency
1
max context tokens
524,288
tensor parallel
4
Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at
2026-08-30T09:10:02Z
capabilities.chat · reason capability-not-verified
capabilities.chat · state unknown
capabilities.reasoning · provenance · captured at
2026-08-30T09:10:02Z
capabilities.reasoning · reason capability-not-verified
capabilities.reasoning · state unknown
capabilities.tools · provenance · captured at
2026-08-30T09:10:02Z
capabilities.tools · reason capability-not-verified
capabilities.tools · state unknown
capabilities.vision · provenance · captured at
2026-08-30T09:10:02Z
capabilities.vision · reason capability-not-verified
capabilities.vision · state unknown
engine.graph mode · provenance · captured at
2026-08-30T09:10:02Z
engine.graph mode · reason runtime-detail-not-published
engine.graph mode · state unknown
serving.kv cache tokens · provenance · captured at
2026-08-30T09:10:02Z
serving.kv cache tokens · reason kv-cache-capacity-not-published
serving.kv cache tokens · state unknown

metadata

localmaxxing · backend
cuda
localmaxxing · hardware label
RTX PRO 6000 Blackwell
localmaxxing · notes
Single-stream text benchmark on four discrete 96 GB PCIe GPUs: 2 warmups followed by 5 measured streaming temperature-0/top-p-1 runs; median reported (47.80-47.93 output tok/s). Experimental abliterated Q2_K_MXFP4 split GGUF; use requires output review. Official llama.cpp CUDA build 9445 used one 524,288-token slot, Q8 K/V, layer split, continuous batching, no speculative decoding, and automatic fit with a 4 GiB per-GPU safety target. Repeated-prompt TTFT is warm-cache. Generation authentication, exact identity/context, coherent text, automatic tools, streaming, cancellation, and zero restart/OOM passed. Metrics use server usage counters and client-observed token timing.
localmaxxing · observed command
llama-server --model GLM-5.2-UD-Q2_K_MXFP4-00001-of-00007.gguf --alias GLM-5.2 --ctx-size 524288 --parallel 1 --threads 32 --threads-batch 32 --batch-size 2048 --ubatch-size 512 --gpu-layers auto --split-mode layer --fit on --fit-target 4096 --fit-ctx 32768 --flash-attn auto --cache-type-k q8_0 --cache-type-v q8_0 --jinja --reasoning auto --reasoning-format deepseek --cont-batching
localmaxxing · run id
cms8lztrn0011pm01khyyqij8
localmaxxing · tokenized · arguments
llama-server, --model, GLM-5.2-UD-Q2_K_MXFP4-00001-of-00007.gguf, --alias, GLM-5.2, --ctx-size, 524288, --parallel, 1, --threads, 32, --threads-batch, 32, --batch-size, 2048, --ubatch-size, 512, --gpu-layers, auto, --split-mode, layer, --fit, on, --fit-target, 4096, --fit-ctx, 32768, --flash-attn, auto, --cache-type-k, q8_0, --cache-type-v, q8_0, --jinja, --reasoning, auto, --reasoning-format, deepseek, --cont-batching
localmaxxing · tokenized · fidelity
faithful

provenance

captured at
2026-08-30T09:10:02Z

sources

captured atkindurl
2026-08-30T09:10:02Znormalized-recipewww.localmaxxing.com/en/runs/cms8lztrn0011pm01khyyqij8 ↗