Speed sweep

deepseek-v4-flash-iq3-xxs-rtx-pro-6000-blackwell-96gb-llama-cpp-tp1-sweep

deepseek-v4-flash-iq3-xxs-rtx-pro-6000-blackwell-96gb-llama-cpp-tp1-sweep

Record

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status
1	262,144	1,688	80.8	9,240	observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id: deepseek-v4-flash-iq3-xxs-rtx-pro-6000-blackwell-96gb-llama-cpp-tp1-sweep
measured at: 2026-07-08T19:31:46.446Z
recipe id: deepseek-v4-flash-iq3-xxs-rtx-pro-6000-blackwell-96gb-llama-cpp-tp1
schema version: local-ai-registry/v1

metrics

concurrency: 1
inference engine version: dsv4 fork + in-graph K=1 MTP + prefill kernel patches (batched indexer top-k, compact MoE work-list)
latest point at: 2026-07-08T19:31:46.446Z
max context tokens: 262,144
peak generation tps: 80.8
peak prompt tps: 1,688
point count: 1

rows

concurrency	context tokens	decode tok s	decode tok s per stream	output tokens	peak vram gb	prefill tok s	samples
1	262,144	80.8	80.8	47,667	94.5	1,688	1

Provenance & metadata (1)

source