Speed sweep

qwen3-8-27b-autoround-int4-w4a16-intel-arc-pro-b70-32gb-vllm-tp2-sweep

qwen3-8-27b-autoround-int4-w4a16-intel-arc-pro-b70-32gb-vllm-tp2-sweep

Record

Recipe
qwen3-8-27b-autoround-int4-w4a16-intel-arc-pro-b70-32gb-vllm-tp2
Measured
2026-08-18T23:54:43.801Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
—2,048—101.91,162.2observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
qwen3-8-27b-autoround-int4-w4a16-intel-arc-pro-b70-32gb-vllm-tp2-sweep
measured at
2026-08-18T23:54:43.801Z
recipe id
qwen3-8-27b-autoround-int4-w4a16-intel-arc-pro-b70-32gb-vllm-tp2
schema version
local-ai-registry/v1

metrics

inference engine version
v0.20.2rc1.dev13+g9557d9108 local XPU stack; vllm 44fc8fde09; vllm-xpu-kernels 2dd55f380d; oneCCL 4ceafd1
latest point at
2026-08-18T23:54:43.801Z
max context tokens
2,048
peak generation tps
101.922
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
Unknown2,048101.922Unknown512UnknownUnknown1
Provenance & metadata (1)