Speed sweep

qwen3-6-27b-q8-0-rtx-3090-24gb-llama-cpp-tp2-sweep

qwen3-6-27b-q8-0-rtx-3090-24gb-llama-cpp-tp2-sweep

Record

Recipe
qwen3-6-27b-q8-0-rtx-3090-24gb-llama-cpp-tp2
Measured
2026-05-14T01:49:46.662Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
18,19245.5804.4observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
qwen3-6-27b-q8-0-rtx-3090-24gb-llama-cpp-tp2-sweep
measured at
2026-05-14T01:49:46.662Z
recipe id
qwen3-6-27b-q8-0-rtx-3090-24gb-llama-cpp-tp2
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
am17an mtp-clean b1-ebe4fca
latest point at
2026-05-14T01:49:46.662Z
max context tokens
8,192
peak generation tps
45.5
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
18,19245.545.551219Unknown1
Provenance & metadata (1)