Recipe
qwen38-q4km-arcb70-llamacpp-tp2
qwen38-q4km-arcb70-llamacpp-tp2Two-B70 Qwen3.8-27B Q4_K_M llama.cpp SYCL candidate. A fresh live screen found four 65,536-token slots, correct chat output, and C1/C2/C4 measurements through 8K, but the checked-in parallel-4 profile cannot expose the claimed 128K per-request context and becomes strongly asymmetric under concurrency.
Record
- Status
- candidate
- Source
- 0xsero
- Engine
- llama-cpp
- Engine version
- 4302fb59969a5d8cf9f8e5f55fdd4506d0ed2126+b70-patches
- Graph
- not-applicable
- Accelerators
- 2
- Tensor parallel
- 2
- Context tokens
- 8,192
- Max concurrency
- 4
- chat
- yes
- reasoning
- no
- tools
- no
- vision
- no
Hugging Face model card
Identity
https://huggingface.co/ggml-org/Qwen3.8-27B-GGUF- Repository
- ggml-org/Qwen3.8-27B-GGUF
- Status
- known
- Link type
- Exact Hub repository
Public Hugging Face repository confirmed by the Hub API.
Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.
Compose configuration
llama-cpp
Container · candidate · docker compose
Candidate evidence — not a Run contract
- Compose file
compose.yml- Port
- 8010
Environment
| Variable | Value |
|---|---|
BATCH | 8192 |
DRAFT_NGL | 0 |
DRAFT_THREADS | 16 |
ENABLE_MTP | 1 |
ENABLE_VISION | 0 |
GPU_COUNT | 2 |
PARALLEL | 4 |
SPEC_DRAFT_N_MAX | 5 |
THREADS | 16 |
UBATCH | 8192 |
Measured speed
| Concurrency | Context | Prefill | Decode | TTFT ms | Status | Sweep |
|---|---|---|---|---|---|---|
| 1 | 2,500 | 955 | 51.1 | — | historical | qwen38-q4km-arcb70-llamacpp-tp2-sweep |
| 1 | 10,000 | 881 | 50.9 | — | historical | qwen38-q4km-arcb70-llamacpp-tp2-sweep |
| 1 | 20,000 | 801 | 51.1 | — | historical | qwen38-q4km-arcb70-llamacpp-tp2-sweep |
| 1 | 40,000 | 694 | 49.7 | — | historical | qwen38-q4km-arcb70-llamacpp-tp2-sweep |
| 1 | 60,000 | 563 | 46.9 | — | historical | qwen38-q4km-arcb70-llamacpp-tp2-sweep |
| 1 | 160,000 | 365 | 42 | — | historical | qwen38-q4km-arcb70-llamacpp-tp2-sweep |
| 1 | 245,000 | 275 | 30.8 | — | historical | qwen38-q4km-arcb70-llamacpp-tp2-sweep |
| 1 | 1,024 | 406.2 | 35.7 | — | candidate | qwen38-q4km-arcb70-llamacpp-tp2-sweep |
| 2 | 1,024 | 358.9 | 13.3 | — | candidate | qwen38-q4km-arcb70-llamacpp-tp2-sweep |
| 4 | 1,024 | 201.7 | 9 | — | candidate | qwen38-q4km-arcb70-llamacpp-tp2-sweep |
| 1 | 8,192 | 361.9 | 27 | — | candidate | qwen38-q4km-arcb70-llamacpp-tp2-sweep |
| 2 | 8,192 | 367.5 | 9.1 | — | candidate | qwen38-q4km-arcb70-llamacpp-tp2-sweep |
| 4 | 8,192 | 258.1 | 5.4 | — | candidate | qwen38-q4km-arcb70-llamacpp-tp2-sweep |
Remaining fields
Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.
- hardware count
- 2
- hardware id
- intel-arc-pro-b70-32gb
- id
- qwen38-q4km-arcb70-llamacpp-tp2
- model instance id
- ggml-org-qwen3-8-27b-gguf--q4-k-m
- recipe source
- 0xsero
- schema version
- local-ai-registry/v1
- speed sweep ids
- qwen38-q4km-arcb70-llamacpp-tp2-sweep
- status
- candidate
capabilities
- chat
- Yes
- reasoning
- No
- tools
- No
- vision
- No
engine
- graph mode
- not-applicable
- name
- llama-cpp
- version
- 4302fb59969a5d8cf9f8e5f55fdd4506d0ed2126+b70-patches
serving
- max concurrency
- 4
- max context tokens
- 8,192
- tensor parallel
- 2
Provenance & metadata (3)
facts
- serving.kv cache tokens · provenance · captured at
- 2026-08-27T06:04:13.773Z
metadata
provenance
- captured at
- 2026-08-27T06:04:13.773Z
sources
| captured at | kind | url |
|---|---|---|
| 2026-08-27T06:04:13.773Z | normalized-recipe | github.com/0xSero/local-ai-registry ↗ |