Local AI Registry

Recipe

qwen3-6-35b-a3b-quark-w8a8-int8-intel-arc-pro-b70-32gb-vllm-tp4-49aoa79o

qwen3-6-35b-a3b-quark-w8a8-int8-intel-arc-pro-b70-32gb-vllm-tp4-49aoa79o
JSON APIFind compatible recipes

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status
candidate
Source
localmaxxing
Engine
vllm
Engine version
0.20.2rc1.dev2+gc51df4300.d20260523
Graph
piecewise
Accelerators
4
Tensor parallel
4
Context tokens
32,768
Max concurrency
48
chat
unknown
reasoning
unknown
tools
unknown
vision
unknown

Hugging Face model card

Identity

https://huggingface.co/nameistoken/Qwen3.6-35B-A3B-Quark-W8A8-INT8
Repository
nameistoken/Qwen3.6-35B-A3B-Quark-W8A8-INT8
Status
known
Link type
Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

vllm

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source
https://www.localmaxxing.com/en/runs/cmq8yhxvo001ipb0149aoa79o

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

  1. vllm
  2. serve
  3. /mnt/fast-ai/llm-cache/hf/models--nameistoken--Qwen3.6-35B-A3B-Quark-W8A8-INT8/snapshots/cced56592e8c8935f8220836b4baa04dfd389118
  4. --host
  5. 127.0.0.1
  6. --port
  7. 18080
  8. --trust-remote-code
  9. --served-model-name
  10. qwen36-35b-a3b-fp8
  11. --dtype
  12. auto
  13. --quantization
  14. quark
  15. --tensor-parallel-size
  16. 4
  17. --pipeline-parallel-size
  18. 1
  19. --distributed-executor-backend
  20. mp
  21. --max-model-len
  22. 32768
  23. --max-num-batched-tokens
  24. 8192
  25. --max-num-seqs
  26. 48
  27. --gpu-memory-utilization
  28. 0.95
  29. --kv-cache-dtype
  30. auto
  31. --no-enable-prefix-caching
  32. --language-model-only
  33. --compilation-config
  34. {cudagraph_mode:PIECEWISE}
  35. --generation-config
  36. vllm
FlagValue
--host127.0.0.1
--port18080
--served-model-nameqwen36-35b-a3b-fp8
--dtypeauto
--quantizationquark
--tensor-parallel-size4
--pipeline-parallel-size1
--distributed-executor-backendmp
--max-model-len32768
--max-num-batched-tokens8192
--max-num-seqs48
--gpu-memory-utilization0.95
--kv-cache-dtypeauto
--compilation-config{cudagraph_mode:PIECEWISE}
--generation-configvllm

Environment

VariableValue
CCL_ATL_TRANSPORTofi
CCL_KVS_IFACEeth1
CCL_TOPO_P2P_ACCESS1
FI_TCP_IFACEeth1
ONEAPI_DEVICE_SELECTORlevel_zero:0,1,2,3
VLLM_TARGET_DEVICExpu
VLLM_USE_V11
VLLM_XPU_COMPILE_ALLREDUCE_CUSTOM_OP1
VLLM_XPU_CUSTOM_ALLREDUCE_CLONE_INPUT1
VLLM_XPU_CUSTOM_ALLREDUCE_GRAPH_CLONE_INPUT1
VLLM_XPU_ENABLE_XPU_GRAPH1
VLLM_XPU_FORCE_GRAPH_WITH_COMM1
VLLM_XPU_GDN_REUSE_QKVZ_BA_QUANTclone
VLLM_XPU_GRAPH_NOOP_COMM_CAPTURE1
VLLM_XPU_QUARK_W8A8_MOE1
VLLM_XPU_USE_CUSTOM_OP_COLLECTIVES1
XPU_GRAPH1
ZE_AFFINITY_MASK0,1,2,3

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatusSweep
—32,768—99.476.5observedqwen3-6-35b-a3b-quark-w8a8-int8-intel-arc-pro-b70-32gb-vllm-tp4-49aoa79o-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count
4
hardware id
intel-arc-pro-b70-32gb
id
qwen3-6-35b-a3b-quark-w8a8-int8-intel-arc-pro-b70-32gb-vllm-tp4-49aoa79o
model instance id
nameistoken-qwen3-6-35b-a3b-quark-w8a8-int8--quark-w8a8-int8
recipe source
localmaxxing
schema version
local-ai-registry/v1
speed sweep ids
qwen3-6-35b-a3b-quark-w8a8-int8-intel-arc-pro-b70-32gb-vllm-tp4-49aoa79o-sweep
status
candidate

capabilities

engine

graph mode
piecewise
name
vllm
version
0.20.2rc1.dev2+gc51df4300.d20260523

serving

max concurrency
48
max context tokens
32,768
tensor parallel
4
Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at
2026-08-30T09:10:02Z
capabilities.chat · reason capability-not-verified
capabilities.chat · state unknown
capabilities.reasoning · provenance · captured at
2026-08-30T09:10:02Z
capabilities.reasoning · reason capability-not-verified
capabilities.reasoning · state unknown
capabilities.tools · provenance · captured at
2026-08-30T09:10:02Z
capabilities.tools · reason capability-not-verified
capabilities.tools · state unknown
capabilities.vision · provenance · captured at
2026-08-30T09:10:02Z
capabilities.vision · reason capability-not-verified
capabilities.vision · state unknown
engine.graph mode · provenance · captured at
2026-09-01T01:32:29Z
engine.graph mode · reason explicit-cudagraph-mode-in-observed-command
engine.graph mode · state known
serving.kv cache tokens · provenance · captured at
2026-08-30T09:10:02Z
serving.kv cache tokens · reason kv-cache-capacity-not-published
serving.kv cache tokens · state unknown
serving.max concurrency · provenance · captured at
2026-09-01T10:20:39Z
serving.max concurrency · reason explicit-source-server-capacity
serving.max concurrency · state known
serving.max context tokens · provenance · captured at
2026-09-01T10:20:39Z
serving.max context tokens · reason explicit-source-context-limit
serving.max context tokens · state known

metadata

localmaxxing · backend
xpu
localmaxxing · batch size
1
localmaxxing · hardware label
Intel Arc Pro B70
localmaxxing · notes
Quality-gated Qwen3.6 35B Quark W8A8 INT8 run on 4x Intel Arc Pro B70. Metric is p512/n512 streaming /v1/completions, temperature 0, four repeats after warmup. tokSOut is corrected steady-state output throughput after first streamed text chunk; e2e output mean was 98.16 tok/s. Frontdoor quality rerun8 passed exact canaries, JSON schema/semantics, copy phrase, 8K long-context needle, repeat stability, and baseline hash parity. Peak VRAM was not submitted because this run used --skip-vram.
localmaxxing · observed command
VLLM_USE_V1=1 VLLM_TARGET_DEVICE=xpu XPU_GRAPH=1 VLLM_XPU_ENABLE_XPU_GRAPH=1 VLLM_XPU_FORCE_GRAPH_WITH_COMM=1 VLLM_XPU_GRAPH_NOOP_COMM_CAPTURE=1 VLLM_XPU_USE_CUSTOM_OP_COLLECTIVES=1 VLLM_XPU_COMPILE_ALLREDUCE_CUSTOM_OP=1 VLLM_XPU_CUSTOM_ALLREDUCE_GRAPH_CLONE_INPUT=1 VLLM_XPU_CUSTOM_ALLREDUCE_CLONE_INPUT=1 VLLM_XPU_QUARK_W8A8_MOE=1 VLLM_XPU_GDN_REUSE_QKVZ_BA_QUANT=clone ONEAPI_DEVICE_SELECTOR=level_zero:0,1,2,3 ZE_AFFINITY_MASK=0,1,2,3 CCL_ATL_TRANSPORT=ofi CCL_TOPO_P2P_ACCESS=1 FI_TCP_IFACE=eth1 CCL_KVS_IFACE=eth1 vllm serve /mnt/fast-ai/llm-cache/hf/models--nameistoken--Qwen3.6-35B-A3B-Quark-W8A8-INT8/snapshots/cced56592e8c8935f8220836b4baa04dfd389118 --host 127.0.0.1 --port 18080 --trust-remote-code --served-model-name qwen36-35b-a3b-fp8 --dtype auto --quantization quark --tensor-parallel-size 4 --pipeline-parallel-size 1 --distributed-executor-backend mp --max-model-len 32768 --max-num-batched-tokens 8192 --max-num-seqs 48 --gpu-memory-utilization 0.95 --kv-cache-dtype auto --no-enable-prefix-caching --language-model-only --compilation-config {"cudagraph_mode":"PIECEWISE"} --generation-config vllm
localmaxxing · run id
cmq8yhxvo001ipb0149aoa79o
localmaxxing · tokenized · arguments
vllm, serve, /mnt/fast-ai/llm-cache/hf/models--nameistoken--Qwen3.6-35B-A3B-Quark-W8A8-INT8/snapshots/cced56592e8c8935f8220836b4baa04dfd389118, --host, 127.0.0.1, --port, 18080, --trust-remote-code, --served-model-name, qwen36-35b-a3b-fp8, --dtype, auto, --quantization, quark, --tensor-parallel-size, 4, --pipeline-parallel-size, 1, --distributed-executor-backend, mp, --max-model-len, 32768, --max-num-batched-tokens, 8192, --max-num-seqs, 48, --gpu-memory-utilization, 0.95, --kv-cache-dtype, auto, --no-enable-prefix-caching, --language-model-only, --compilation-config, {cudagraph_mode:PIECEWISE}, --generation-config, vllm
localmaxxing · tokenized · environment · CCL ATL TRANSPORT
ofi
localmaxxing · tokenized · environment · CCL KVS IFACE
eth1
localmaxxing · tokenized · environment · CCL TOPO P2P ACCESS
1
localmaxxing · tokenized · environment · FI TCP IFACE
eth1
localmaxxing · tokenized · environment · ONEAPI DEVICE SELECTOR
level_zero:0,1,2,3
localmaxxing · tokenized · environment · VLLM TARGET DEVICE
xpu
localmaxxing · tokenized · environment · VLLM USE V1
1
localmaxxing · tokenized · environment · VLLM XPU COMPILE ALLREDUCE CUSTOM OP
1
localmaxxing · tokenized · environment · VLLM XPU CUSTOM ALLREDUCE CLONE INPUT
1
localmaxxing · tokenized · environment · VLLM XPU CUSTOM ALLREDUCE GRAPH CLONE INPUT
1
localmaxxing · tokenized · environment · VLLM XPU ENABLE XPU GRAPH
1
localmaxxing · tokenized · environment · VLLM XPU FORCE GRAPH WITH COMM
1
localmaxxing · tokenized · environment · VLLM XPU GDN REUSE QKVZ BA QUANT
clone
localmaxxing · tokenized · environment · VLLM XPU GRAPH NOOP COMM CAPTURE
1
localmaxxing · tokenized · environment · VLLM XPU QUARK W8A8 MOE
1
localmaxxing · tokenized · environment · VLLM XPU USE CUSTOM OP COLLECTIVES
1
localmaxxing · tokenized · environment · XPU GRAPH
1
localmaxxing · tokenized · environment · ZE AFFINITY MASK
0,1,2,3
localmaxxing · tokenized · fidelity
faithful

provenance

captured at
2026-08-30T09:10:02Z

sources

captured atkindurl
2026-08-30T09:10:02Znormalized-recipewww.localmaxxing.com/en/runs/cmq8yhxvo001ipb0149aoa79o ↗