Recipe
deepseek-v4-flash-fp8-rtxpro6000-sglang-tp4
deepseek-v4-flash-fp8-rtxpro6000-sglang-tp4Pinned-source DeepSeek V4 Flash FP8 SGLang TP4 candidate using the SM120 sparse-decode extension, built-in DeepSeek V4 encoding, EAGLE2, and CUDA graphs. It is intentionally indexed under SGLang. The tag-only image, unpinned model revision, and host-built extension keep CLI launch blocked.
Record
- Status
- candidate
- Source
- 0xsero
- Engine
- sglang
- Engine version
- deepseek-v4-blackwell image; exact SGLang commit unreported
- Graph
- full
- Accelerators
- 4
- Tensor parallel
- 4
- Context tokens
- 300,000
- Max concurrency
- 1
- chat
- yes
- reasoning
- yes
- tools
- yes
- vision
- no
Hugging Face model card
Identity
https://huggingface.co/sgl-project/DeepSeek-V4-Flash-FP8- Repository
- sgl-project/DeepSeek-V4-Flash-FP8
- Status
- known
- Link type
- Exact Hub repository
Public Hugging Face repository confirmed by the Hub API.
Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.
Compose configuration
sglang
Container · candidate · docker compose
Candidate evidence — not a Run contract
- Compose file
compose.yml- Port
- 8000
Environment
| Variable | Value |
|---|---|
CUDA_VISIBLE_DEVICES | 0,1,2,3 |
PYTHONPATH | /dsv4 |
SGLANG_ENABLE_SPEC_V2 | True |
SGLANG_ENABLE_THINKING | 1 |
Measured speed
| Concurrency | Context | Prefill | Decode | TTFT ms | Status | Sweep |
|---|---|---|---|---|---|---|
| 1 | 8,192 | 701.6 | 37.6 | 11,337 | historical | deepseek-v4-flash-fp8-rtxpro6000-sglang-tp4-sweep |
| 1 | 16,384 | 1,250 | 38 | 12,770 | historical | deepseek-v4-flash-fp8-rtxpro6000-sglang-tp4-sweep |
| 1 | 32,768 | 1,273.1 | 35.5 | 25,101 | historical | deepseek-v4-flash-fp8-rtxpro6000-sglang-tp4-sweep |
| 1 | 65,536 | 1,145.1 | 30.3 | 55,850 | historical | deepseek-v4-flash-fp8-rtxpro6000-sglang-tp4-sweep |
| 1 | 131,072 | 946 | 24.1 | 135,271 | historical | deepseek-v4-flash-fp8-rtxpro6000-sglang-tp4-sweep |
| 1 | 196,000 | 793.8 | 19.3 | 246,863 | historical | deepseek-v4-flash-fp8-rtxpro6000-sglang-tp4-sweep |
| 1 | 300,000 | 646.4 | 15.1 | 464,072 | historical | deepseek-v4-flash-fp8-rtxpro6000-sglang-tp4-sweep |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- hardware count
- 4
- hardware id
- rtx-pro-6000-blackwell-96gb
- id
- deepseek-v4-flash-fp8-rtxpro6000-sglang-tp4
- model instance id
- sgl-project-deepseek-v4-flash-fp8--fp8
- recipe source
- 0xsero
- schema version
- local-ai-registry/v1
- speed sweep ids
- deepseek-v4-flash-fp8-rtxpro6000-sglang-tp4-sweep
- status
- candidate
capabilities
- chat
- Yes
- reasoning
- Yes
- tools
- Yes
- vision
- No
engine
- graph mode
- full
- name
- sglang
- version
- deepseek-v4-blackwell image; exact SGLang commit unreported
serving
- max concurrency
- 1
- max context tokens
- 300,000
- tensor parallel
- 4
Provenance & metadata (3)
facts
- serving.kv cache tokens · provenance · captured at
- 2026-08-27T06:04:13.773Z
metadata
provenance
- captured at
- 2026-08-27T06:04:13.773Z
sources
| captured at | kind | url |
|---|---|---|
| 2026-08-27T06:04:13.773Z | normalized-recipe | github.com/0xSero/local-ai-registry ↗ |