Speed sweep
deepseek-v4-flash-0731-nvfp4-dgxspark-vllm-tp2-sweep
deepseek-v4-flash-0731-nvfp4-dgxspark-vllm-tp2-sweepRecord
- Measured
- 2026-08-01
- Accepted
- 2026-08-23
- Points
- 19
Measured speed
| Concurrency | Context | Prefill | Decode | TTFT ms | Status |
|---|---|---|---|---|---|
| 1 | 256 | 447 | 75.4 | — | historical |
| 2 | 256 | 357 | 58.3 | — | historical |
| 4 | 256 | 222 | 46.8 | — | historical |
| 6 | 256 | 197 | 36.9 | — | historical |
| 1 | 2,048 | 2,563 | 68.8 | — | historical |
| 2 | 2,048 | 1,911 | 57 | — | historical |
| 4 | 2,048 | 1,505 | 44 | — | historical |
| 6 | 2,048 | 342 | 34.7 | — | historical |
| 1 | 8,192 | 1,713 | 73.9 | — | historical |
| 2 | 8,192 | 1,176 | 49.8 | — | historical |
| 4 | 8,192 | 578 | 37.4 | — | historical |
| 6 | 8,192 | 454 | 23.6 | — | historical |
| 1 | 32,768 | 1,428 | 64 | — | historical |
| 2 | 32,768 | 1,287 | 41.5 | — | historical |
| 4 | 32,768 | 756 | 17.4 | — | historical |
| 6 | 32,768 | 550 | 10.8 | — | historical |
| 1 | 131,072 | 1,665 | 65.2 | — | historical |
| 2 | 131,072 | 1,306 | 30.9 | — | historical |
| 1 | 899,994 | 874.8 | — | — | historical |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- accepted at
- 2026-08-23
- id
- deepseek-v4-flash-0731-nvfp4-dgxspark-vllm-tp2-sweep
- measured at
- 2026-08-01
- recipe id
- deepseek-v4-flash-0731-nvfp4-dgxspark-vllm-tp2
- schema version
- local-ai-registry/v1
metrics
- concurrency
- 6
- inference engine version
- 0.25.2+anemll-dspark-gx10-0.1.1
- latest point at
- 2026-08-01
- max context tokens
- 899,994
- peak generation tps
- 191.2
- peak prompt tps
- 2,563
- point count
- 19
rows
| concurrency | context tokens | decode tok s | decode tok s per stream | output tokens | peak vram gb | prefill tok s | samples |
|---|---|---|---|---|---|---|---|
| 1 | 256 | 69.1 | 75.4 | 512 | Unknown | 447 | 1 |
| 2 | 256 | 104.9 | 58.3 | 512 | Unknown | 357 | 1 |
| 4 | 256 | 164.5 | 46.8 | 512 | Unknown | 222 | 1 |
| 6 | 256 | 191.2 | 36.9 | 512 | Unknown | 197 | 1 |
| 1 | 2,048 | 62 | 68.8 | 512 | Unknown | 2,563 | 1 |
| 2 | 2,048 | 97.6 | 57 | 512 | Unknown | 1,911 | 1 |
| 4 | 2,048 | 154.7 | 44 | 512 | Unknown | 1,505 | 1 |
| 6 | 2,048 | 143.7 | 34.7 | 512 | Unknown | 342 | 1 |
| 1 | 8,192 | 43.7 | 73.9 | 512 | Unknown | 1,713 | 1 |
| 2 | 8,192 | 56.2 | 49.8 | 512 | Unknown | 1,176 | 1 |
| 4 | 8,192 | 72.3 | 37.4 | 512 | Unknown | 578 | 1 |
| 6 | 8,192 | 73.1 | 23.6 | 512 | Unknown | 454 | 1 |
| 1 | 32,768 | 16.6 | 64 | 512 | Unknown | 1,428 | 1 |
| 2 | 32,768 | 24.8 | 41.5 | 512 | Unknown | 1,287 | 1 |
| 4 | 32,768 | 26.7 | 17.4 | 512 | Unknown | 756 | 1 |
| 6 | 32,768 | 27.9 | 10.8 | 512 | Unknown | 550 | 1 |
| 1 | 131,072 | 5.9 | 65.2 | 512 | Unknown | 1,665 | 1 |
| 2 | 131,072 | 6.6 | 30.9 | 512 | Unknown | 1,306 | 1 |
| 1 | 899,994 | Unknown | Unknown | 512 | Unknown | 874.8 | 1 |
Provenance & metadata (1)
source
- commit
- f104c39a8c6fa68d4ea0b342ad6eed172bc0e635
- paths
- start-deepseek-v4-flash-dspark.sh, .env.dspark.example, docker-compose.dspark.yml, results/RESULTS-2026-08-14.md