Speed sweep

qwen3-6-27b-autoround-int4-w4a16-runtime-int8-lm-head-intel-arc-pro-b70-32gb-vllm-tp1-8408i1pn-sweep

qwen3-6-27b-autoround-int4-w4a16-runtime-int8-lm-head-intel-arc-pro-b70-32gb-vllm-tp1-8408i1pn-sweep

Record

Recipe: qwen3-6-27b-autoround-int4-w4a16-runtime-int8-lm-head-intel-arc-pro-b70-32gb-vllm-tp1-8408i1pn
Measured: 2026-07-03T13:45:34.320Z
Points: 1

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status
—	2,048	—	62.6	606.6	observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id: qwen3-6-27b-autoround-int4-w4a16-runtime-int8-lm-head-intel-arc-pro-b70-32gb-vllm-tp1-8408i1pn-sweep
measured at: 2026-07-03T13:45:34.320Z
recipe id: qwen3-6-27b-autoround-int4-w4a16-runtime-int8-lm-head-intel-arc-pro-b70-32gb-vllm-tp1-8408i1pn
schema version: local-ai-registry/v1

metrics

inference engine version: 0.20.2rc1.dev13+g9557d9108.d20260620 local XPU patch stack
latest point at: 2026-07-03T13:45:34.320Z
max context tokens: 2,048
peak generation tps: 62.628
point count: 1

rows

concurrency	context tokens	decode tok s	decode tok s per stream	output tokens	peak vram gb	prefill tok s	samples
Unknown	2,048	62.628	Unknown	128	Unknown	Unknown	1

Provenance & metadata (1)

source