Speed sweep
qwen38-awq-int4-rtx3090-sglang-tp4-sweep
qwen38-awq-int4-rtx3090-sglang-tp4-sweepRecord
- Measured
- 2026-08-23
- Accepted
- 2026-08-25
- Points
- 20
Measured speed
| Concurrency | Context | Prefill | Decode | TTFT ms | Status |
|---|---|---|---|---|---|
| 1 | 8,744 | 1,580.8 | 136.2 | 5,530 | historical |
| 2 | 8,745 | 1,495.2 | 103.8 | 5,850 | historical |
| 4 | 8,749 | 1,353.6 | 80.5 | 6,460 | historical |
| 8 | 8,747 | 1,130 | 60.5 | 7,740 | historical |
| 1 | 17,397 | 1,615.8 | 128.9 | 10,770 | historical |
| 2 | 17,398 | 1,455.1 | 97.1 | 11,960 | historical |
| 4 | 17,397 | 1,368.5 | 66.9 | 12,710 | historical |
| 8 | 17,397 | 1,141.7 | 45.6 | 15,240 | historical |
| 1 | 34,688 | 1,576.5 | 126.6 | 22,000 | historical |
| 2 | 34,688 | 1,494.4 | 93.4 | 23,210 | historical |
| 4 | 34,686 | 1,358 | 59.6 | 25,540 | historical |
| 8 | 34,690 | 1,300.1 | 39.2 | 26,680 | historical |
| 1 | 69,273 | 1,494.9 | 113.4 | 46,340 | historical |
| 2 | 69,271 | 1,426.2 | 100.6 | 48,570 | historical |
| 4 | 69,268 | 1,376.7 | 55 | 50,320 | historical |
| 8 | 69,273 | 1,368.7 | 38 | 50,610 | historical |
| 1 | 138,450 | 1,400.2 | 104.6 | 98,880 | historical |
| 2 | 138,451 | 1,356.1 | 74.2 | 102,090 | historical |
| 4 | 138,448 | 1,337.9 | 47 | 103,480 | historical |
| 8 | 138,452 | 1,337.9 | 29.3 | 103,480 | historical |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- accepted at
- 2026-08-25
- id
- qwen38-awq-int4-rtx3090-sglang-tp4-sweep
- measured at
- 2026-08-23
- recipe id
- qwen38-awq-int4-rtx3090-sglang-tp4
- schema version
- local-ai-registry/v1
metrics
- concurrency
- 8
- latest point at
- 2026-08-23
- max context tokens
- 138,452
- peak generation tps
- 136.8
- peak prompt tps
- 1,615.8
- point count
- 20
rows
| concurrency | context tokens | decode tok s | decode tok s per stream | output tokens | peak vram gb | prefill tok s | samples |
|---|---|---|---|---|---|---|---|
| 1 | 8,744 | 136.8 | 136.2 | Unknown | Unknown | 1,580.8 | 1 |
| 2 | 8,745 | 103.8 | Unknown | Unknown | Unknown | 1,495.2 | 1 |
| 4 | 8,749 | 80.5 | Unknown | Unknown | Unknown | 1,353.6 | 1 |
| 8 | 8,747 | 60.5 | Unknown | Unknown | Unknown | 1,130 | 1 |
| 1 | 17,397 | 129.4 | 128.9 | Unknown | Unknown | 1,615.8 | 1 |
| 2 | 17,398 | 97.1 | Unknown | Unknown | Unknown | 1,455.1 | 1 |
| 4 | 17,397 | 66.9 | Unknown | Unknown | Unknown | 1,368.5 | 1 |
| 8 | 17,397 | 45.6 | Unknown | Unknown | Unknown | 1,141.7 | 1 |
| 1 | 34,688 | 127.1 | 126.6 | Unknown | Unknown | 1,576.5 | 1 |
| 2 | 34,688 | 93.4 | Unknown | Unknown | Unknown | 1,494.4 | 1 |
| 4 | 34,686 | 59.6 | Unknown | Unknown | Unknown | 1,358 | 1 |
| 8 | 34,690 | 39.2 | Unknown | Unknown | Unknown | 1,300.1 | 1 |
| 1 | 69,273 | 113.9 | 113.4 | Unknown | Unknown | 1,494.9 | 1 |
| 2 | 69,271 | 100.6 | Unknown | Unknown | Unknown | 1,426.2 | 1 |
| 4 | 69,268 | 55 | Unknown | Unknown | Unknown | 1,376.7 | 1 |
| 8 | 69,273 | 38 | Unknown | Unknown | Unknown | 1,368.7 | 1 |
| 1 | 138,450 | 105 | 104.6 | Unknown | Unknown | 1,400.2 | 1 |
| 2 | 138,451 | 74.2 | Unknown | Unknown | Unknown | 1,356.1 | 1 |
| 4 | 138,448 | 47 | Unknown | Unknown | Unknown | 1,337.9 | 1 |
| 8 | 138,452 | 29.3 | Unknown | Unknown | Unknown | 1,337.9 | 1 |
Provenance & metadata (1)
source
- commit
- 55ab5b924c3d2176c65bf1132d6c2a5d51ab394e
- paths
- Dockerfile, entrypoint.sh, test/entrypoint-test.sh
- repository
- github.com/0xSero/qwen38-3090-sglang ↗