Speed sweep
qwen38-q4km-arcb70-llamacpp-tp1-sweep
qwen38-q4km-arcb70-llamacpp-tp1-sweepRecord
- Measured
- 2026-08-25
- Accepted
- 2026-08-25
- Points
- 6
Measured speed
| Concurrency | Context | Prefill | Decode | TTFT ms | Status |
|---|---|---|---|---|---|
| 1 | 8,024 | 1,016.2 | 27.4 | — | accepted |
| 1 | 2,500 | 1,164 | 33.3 | 1,800 | historical |
| 1 | 10,000 | 1,018 | 33.4 | 7,900 | historical |
| 1 | 40,000 | 785 | 33.4 | 40,800 | historical |
| 1 | 65,000 | 625 | 31.9 | 96,100 | historical |
| 1 | 128,000 | 426 | 27.5 | 282,100 | historical |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- accepted at
- 2026-08-25
- id
- qwen38-q4km-arcb70-llamacpp-tp1-sweep
- measured at
- 2026-08-25
- recipe id
- qwen38-q4km-arcb70-llamacpp-tp1
- schema version
- local-ai-registry/v1
metrics
- concurrency
- 1
- inference engine version
- 4302fb59969a5d8cf9f8e5f55fdd4506d0ed2126+b70-patches
- latest point at
- 2026-08-25
- max context tokens
- 128,000
- peak generation tps
- 33.4
- peak prompt tps
- 1,164
- point count
- 6
rows
| concurrency | context tokens | decode tok s | decode tok s per stream | output tokens | peak vram gb | prefill tok s | samples |
|---|---|---|---|---|---|---|---|
| 1 | 8,024 | 27.395 | 27.395 | 32 | Unknown | 1,016.216 | 1 |
| 1 | 2,500 | 33.3 | 33.3 | 256 | Unknown | 1,164 | 1 |
| 1 | 10,000 | 33.4 | 33.4 | 256 | Unknown | 1,018 | 1 |
| 1 | 40,000 | 33.4 | 33.4 | 256 | Unknown | 785 | 1 |
| 1 | 65,000 | 31.9 | 31.9 | 256 | Unknown | 625 | 1 |
| 1 | 128,000 | 27.5 | 27.5 | 256 | Unknown | 426 | 1 |
Provenance & metadata (1)
source
- commit
- e8738535c8914a4fe6a54235754e27eeb8078601
- paths
- Dockerfile, entrypoint.sh, docker-compose.yml, README.md
- repository
- github.com/0xSero/qwen38-b70 ↗