Speed sweep
qwen38-q4km-arcb70-llamacpp-tp2-sweep
qwen38-q4km-arcb70-llamacpp-tp2-sweepRecord
- Measured
- 2026-08-24
- Accepted
- 2026-08-19
- Points
- 13
Measured speed
| Concurrency | Context | Prefill | Decode | TTFT ms | Status |
|---|---|---|---|---|---|
| 1 | 2,500 | 955 | 51.1 | 2,100 | historical |
| 1 | 10,000 | 881 | 50.9 | 9,100 | historical |
| 1 | 20,000 | 801 | 51.1 | 20,000 | historical |
| 1 | 40,000 | 694 | 49.7 | 46,200 | historical |
| 1 | 60,000 | 563 | 46.9 | 106,600 | historical |
| 1 | 160,000 | 365 | 42 | 355,800 | historical |
| 1 | 245,000 | 275 | 30.8 | 727,300 | historical |
| 1 | 1,024 | 406.2 | 35.7 | — | candidate |
| 2 | 1,024 | 358.9 | 13.3 | — | candidate |
| 4 | 1,024 | 201.7 | 9 | — | candidate |
| 1 | 8,192 | 361.9 | 27 | — | candidate |
| 2 | 8,192 | 367.5 | 9.1 | — | candidate |
| 4 | 8,192 | 258.1 | 5.4 | — | candidate |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- accepted at
- 2026-08-19
- id
- qwen38-q4km-arcb70-llamacpp-tp2-sweep
- measured at
- 2026-08-24
- recipe id
- qwen38-q4km-arcb70-llamacpp-tp2
- schema version
- local-ai-registry/v1
metrics
- concurrency
- 4
- inference engine version
- 4302fb59969a5d8cf9f8e5f55fdd4506d0ed2126+b70-patches
- latest point at
- 2026-08-24
- max context tokens
- 245,000
- peak generation tps
- 51.1
- peak prompt tps
- 955
- point count
- 13
rows
| concurrency | context tokens | decode tok s | decode tok s per stream | output tokens | peak vram gb | prefill tok s | samples |
|---|---|---|---|---|---|---|---|
| 1 | 2,500 | 51.1 | 51.1 | 256 | Unknown | 955 | 1 |
| 1 | 10,000 | 50.9 | 50.9 | 256 | Unknown | 881 | 1 |
| 1 | 20,000 | 51.1 | 51.1 | 256 | Unknown | 801 | 1 |
| 1 | 40,000 | 49.7 | 49.7 | 256 | Unknown | 694 | 1 |
| 1 | 60,000 | 46.9 | 46.9 | 256 | Unknown | 563 | 1 |
| 1 | 160,000 | 42 | 42 | 256 | Unknown | 365 | 1 |
| 1 | 245,000 | 30.8 | 30.8 | 256 | Unknown | 275 | 1 |
| 1 | 1,024 | Unknown | 35.677 | 128 | Unknown | 406.182 | 2 |
| 2 | 1,024 | Unknown | 13.269 | 128 | Unknown | 358.923 | 2 |
| 4 | 1,024 | Unknown | 8.979 | 128 | Unknown | 201.739 | 2 |
| 1 | 8,192 | Unknown | 26.999 | 128 | Unknown | 361.928 | 2 |
| 2 | 8,192 | Unknown | 9.073 | 128 | Unknown | 367.51 | 2 |
| 4 | 8,192 | Unknown | 5.399 | 128 | Unknown | 258.138 | 2 |
Provenance & metadata (1)
source
- commit
- e8738535c8914a4fe6a54235754e27eeb8078601
- paths
- Dockerfile, entrypoint.sh, docker-compose.yml, README.md
- repository
- github.com/0xSero/qwen38-b70 ↗