Speed sweep

qwen38-q4km-arcb70-llamacpp-tp1-sweep

qwen38-q4km-arcb70-llamacpp-tp1-sweep

Record

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status
1	8,024	1,016.2	27.4	—	accepted
1	2,500	1,164	33.3	—	historical
1	10,000	1,018	33.4	—	historical
1	40,000	785	33.4	—	historical
1	65,000	625	31.9	—	historical
1	128,000	426	27.5	—	historical

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

metrics

rows

concurrency	context tokens	decode tok s	decode tok s per stream	output tokens	peak vram gb	prefill tok s	samples
1	8,024	27.395	27.395	32	Unknown	1,016.216	1
1	2,500	33.3	33.3	256	Unknown	1,164	1
1	10,000	33.4	33.4	256	Unknown	1,018	1
1	40,000	33.4	33.4	256	Unknown	785	1
1	65,000	31.9	31.9	256	Unknown	625	1
1	128,000	27.5	27.5	256	Unknown	426	1

Provenance & metadata (1)

source