Speed sweep

qwen3-6-27b-autoround-int4-w4a16-runtime-int8-lm-head-intel-arc-pro-b70-32gb-vllm-tp1-sweep

qwen3-6-27b-autoround-int4-w4a16-runtime-int8-lm-head-intel-arc-pro-b70-32gb-vllm-tp1-sweep

Record

Recipe: qwen3-6-27b-autoround-int4-w4a16-runtime-int8-lm-head-intel-arc-pro-b70-32gb-vllm-tp1
Measured: 2026-07-03
Points: 1

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status
—	2,048	—	64.3	605.9	historical

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id: qwen3-6-27b-autoround-int4-w4a16-runtime-int8-lm-head-intel-arc-pro-b70-32gb-vllm-tp1-sweep
measured at: 2026-07-03
recipe id: qwen3-6-27b-autoround-int4-w4a16-runtime-int8-lm-head-intel-arc-pro-b70-32gb-vllm-tp1
schema version: local-ai-registry/v1

metrics

inference engine version: 0.20.2rc1.dev13+g9557d9108.d20260620 local XPU patch stack
latest point at: 2026-07-03
max context tokens: 2,048
peak generation tps: 64.306
point count: 1

rows

concurrency	context tokens	decode tok s	decode tok s per stream	output tokens	peak vram gb	prefill tok s	samples
Unknown	2,048	64.306	Unknown	128	Unknown	Unknown	1

Provenance & metadata (1)

source