Speed sweep

qwen3-8-27b-uncensored-int4-autoround-gptq-int4-intel-arc-pro-b70-32gb-vllm-tp2-sweep

qwen3-8-27b-uncensored-int4-autoround-gptq-int4-intel-arc-pro-b70-32gb-vllm-tp2-sweep

Record

Recipe: qwen3-8-27b-uncensored-int4-autoround-gptq-int4-intel-arc-pro-b70-32gb-vllm-tp2
Measured: 2026-08-20T02:09:34.946Z
Points: 1

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status
—	2,048	755	136.4	841	observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id: qwen3-8-27b-uncensored-int4-autoround-gptq-int4-intel-arc-pro-b70-32gb-vllm-tp2-sweep
measured at: 2026-08-20T02:09:34.946Z
recipe id: qwen3-8-27b-uncensored-int4-autoround-gptq-int4-intel-arc-pro-b70-32gb-vllm-tp2
schema version: local-ai-registry/v1

metrics

inference engine version: 0.27.2rc1.dev78+g8e6d8e4f6 XPU (custom-patched: host-staged TP2 collectives + INT8 W8A8 lm_head + MTP wiring)
latest point at: 2026-08-20T02:09:34.946Z
max context tokens: 2,048
peak generation tps: 136.4
peak prompt tps: 755
point count: 1

rows

concurrency	context tokens	decode tok s	decode tok s per stream	output tokens	peak vram gb	prefill tok s	samples
Unknown	2,048	136.4	Unknown	37	Unknown	755	1

Provenance & metadata (1)

source