Speed sweep

ling-2-6-flash-modelopt-fp4-experts-only-b16-rtx-pro-6000-blackwell-96gb-sglang-tp1-sweep

ling-2-6-flash-modelopt-fp4-experts-only-b16-rtx-pro-6000-blackwell-96gb-sglang-tp1-sweep

Record

Recipe
ling-2-6-flash-modelopt-fp4-experts-only-b16-rtx-pro-6000-blackwell-96gb-sglang-tp1
Measured
2026-05-08T10:44:36.655Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
32,7688,159.484.13,953.2observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
ling-2-6-flash-modelopt-fp4-experts-only-b16-rtx-pro-6000-blackwell-96gb-sglang-tp1-sweep
measured at
2026-05-08T10:44:36.655Z
recipe id
ling-2-6-flash-modelopt-fp4-experts-only-b16-rtx-pro-6000-blackwell-96gb-sglang-tp1
schema version
local-ai-registry/v1

metrics

inference engine version
0.0.0.dev1+geec794bce
latest point at
2026-05-08T10:44:36.655Z
max context tokens
32,768
peak generation tps
84.116
peak prompt tps
8,159.391
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
Unknown32,76884.116Unknown12883.0968,159.3911
Provenance & metadata (1)