Recipe
kimi-k2.6-nvfp4-rtxpro6000-sglang-tp4
kimi-k2.6-nvfp4-rtxpro6000-sglang-tp4Pinned-source Kimi K2.6 NVFP4 SGLang TP4 candidate with 256K configured context, FP8 KV, multimodal input, and CUDA graphs. The SGLang image is tag-only, the model revision is absent, and no speed sweep is preserved in the source, so CLI launch remains blocked.
Record
- Status
- candidate
- Source
- 0xsero
- Engine
- sglang
- Engine version
- 0.5.12.post1
- Graph
- full
- Accelerators
- 4
- Tensor parallel
- 4
- chat
- yes
- reasoning
- yes
- tools
- yes
- vision
- yes
Hugging Face model card
Identity
https://huggingface.co/0xSero/Kimi-K2.6-519B-NVFP4- Repository
- 0xSero/Kimi-K2.6-519B-NVFP4
- Status
- known
- Link type
- Exact Hub repository
Public Hugging Face repository confirmed by the Hub API.
Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.
Compose configuration
sglang
Container · candidate · docker compose
Candidate evidence — not a Run contract
- Compose file
compose.yml- Port
- 8000
Environment
| Variable | Value |
|---|---|
CUDA_VISIBLE_DEVICES | 0,1,2,3 |
SGLANG_ENABLE_DEEP_GEMM | 0 |
SGLANG_MOE_NVFP4_DISPATCH | 1 |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- hardware count
- 4
- hardware id
- rtx-pro-6000-blackwell-96gb
- id
- kimi-k2.6-nvfp4-rtxpro6000-sglang-tp4
- model instance id
- 0xsero-kimi-k2-6-519b-nvfp4--nvfp4
- recipe source
- 0xsero
- schema version
- local-ai-registry/v1
- status
- candidate
capabilities
- chat
- Yes
- reasoning
- Yes
- tools
- Yes
- vision
- Yes
engine
- graph mode
- full
- name
- sglang
- version
- 0.5.12.post1
serving
- tensor parallel
- 4
Provenance & metadata (3)
facts
- serving.kv cache tokens · provenance · captured at
- 2026-08-27T06:04:13.773Z
serving.kv cache tokens · reason kv-cache-capacity-not-published
serving.kv cache tokens · state unknown
- serving.max concurrency · provenance · captured at
- 2026-08-27T06:04:13.773Z
serving.max concurrency · reason not-observed
serving.max concurrency · state unknown
- serving.max context tokens · provenance · captured at
- 2026-08-27T06:04:13.773Z
serving.max context tokens · reason not-observed
serving.max context tokens · state unknown
- speed sweep ids · provenance · captured at
- 2026-08-27T06:04:13.773Z
speed sweep ids · reason not-observed
speed sweep ids · state unknown
metadata
provenance
- captured at
- 2026-08-27T06:04:13.773Z
sources
| captured at | kind | url |
|---|---|---|
| 2026-08-27T06:04:13.773Z | normalized-recipe | github.com/0xSero/local-ai-registry ↗ |