Speed sweep

lfm25-26b-bf16-rtx5090-sglang-tp1-sweep

lfm25-26b-bf16-rtx5090-sglang-tp1-sweep

Record

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status
1	512	20,760.2	197.6	24.4	accepted
2	512	—	166.4	33.5	accepted
4	512	—	164.4	65.3	accepted
1	7,680	33,494	195.5	229.2	accepted
1	7,680	140,765.2	195.9	53.7	accepted
2	7,680	—	157.5	350.4	accepted
2	7,680	—	163.2	77.9	accepted
4	7,680	—	148.5	667.5	accepted
4	7,680	—	160.3	104.5	accepted
1	32,256	29,079.3	186.4	1,107.6	accepted
1	32,256	440,338.6	186.6	73	accepted
2	32,256	—	129.7	1,672.3	accepted
2	32,256	—	155.4	98.9	accepted
4	32,256	—	110	3,304.3	accepted
4	32,256	—	152.2	148.2	accepted
1	65,024	24,291.8	175.2	2,674.7	accepted
1	65,024	629,957.5	175.8	103.2	accepted
2	65,024	—	101.1	4,025.1	accepted
2	65,024	—	147.8	150.2	accepted
4	65,024	—	77.4	8,004.4	accepted
4	65,024	—	142	211	accepted
1	130,560	18,173.8	158	7,180.9	accepted
1	130,560	819,807.3	158.1	159.3	accepted
2	130,560	—	64	10,828.3	accepted
2	130,560	—	133.6	239.7	accepted
4	130,560	—	43	21,562.3	accepted
4	130,560	—	126.2	319.6	accepted

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

metrics

rows

concurrency	context tokens	decode tok s	decode tok s per stream	output tokens	peak vram gb	prefill tok s	samples
1	512	Unknown	197.6	512	Unknown	20,760.2	2
2	512	Unknown	166.4	512	Unknown	Unknown	2
4	512	Unknown	164.4	512	Unknown	Unknown	2
1	7,680	Unknown	195.5	512	Unknown	33,494	2
1	7,680	Unknown	195.9	512	Unknown	140,765.2	2
2	7,680	Unknown	157.5	512	Unknown	Unknown	2
2	7,680	Unknown	163.2	512	Unknown	Unknown	2
4	7,680	Unknown	148.5	512	Unknown	Unknown	2
4	7,680	Unknown	160.3	512	Unknown	Unknown	2
1	32,256	Unknown	186.4	512	Unknown	29,079.3	2
1	32,256	Unknown	186.6	512	Unknown	440,338.6	2
2	32,256	Unknown	129.7	512	Unknown	Unknown	2
2	32,256	Unknown	155.4	512	Unknown	Unknown	2
4	32,256	Unknown	110	512	Unknown	Unknown	2
4	32,256	Unknown	152.2	512	Unknown	Unknown	2
1	65,024	Unknown	175.2	512	Unknown	24,291.8	2
1	65,024	Unknown	175.8	512	Unknown	629,957.5	2
2	65,024	Unknown	101.1	512	Unknown	Unknown	2
2	65,024	Unknown	147.8	512	Unknown	Unknown	2
4	65,024	Unknown	77.4	512	Unknown	Unknown	2
4	65,024	Unknown	142	512	Unknown	Unknown	2
1	130,560	Unknown	158	512	Unknown	18,173.8	2
1	130,560	Unknown	158.1	512	Unknown	819,807.3	2
2	130,560	Unknown	64	512	Unknown	Unknown	2
2	130,560	Unknown	133.6	512	Unknown	Unknown	2
4	130,560	Unknown	43	512	Unknown	Unknown	2
4	130,560	Unknown	126.2	512	Unknown	Unknown	2

Provenance & metadata (1)

source

commit: 7ddd112db9a3ed9439320fad30cd191166e27064
paths: campaigns/runpod-single-gpu-2026-08-23/protocol.md, campaigns/runpod-single-gpu-2026-08-23/results.csv, campaigns/runpod-single-gpu-2026-08-23/artifacts/rtx-5090-32gb-attempt3
repository: github.com/0xSero/inference-index ↗