Speed sweep

qwen3-vl-30b-a3b-instruct-q4-k-m-apple-m5-max-128gb-llama-cpp-tp1-sweep

qwen3-vl-30b-a3b-instruct-q4-k-m-apple-m5-max-128gb-llama-cpp-tp1-sweep

Record

Recipe
qwen3-vl-30b-a3b-instruct-q4-k-m-apple-m5-max-128gb-llama-cpp-tp1
Measured
2026-07-25T18:23:14.073Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
18,19267,121.5138.68.3observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
qwen3-vl-30b-a3b-instruct-q4-k-m-apple-m5-max-128gb-llama-cpp-tp1-sweep
measured at
2026-07-25T18:23:14.073Z
recipe id
qwen3-vl-30b-a3b-instruct-q4-k-m-apple-m5-max-128gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
b10079
latest point at
2026-07-25T18:23:14.073Z
max context tokens
8,192
peak generation tps
138.63
peak prompt tps
67,121.54
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
18,192138.63138.63128Unknown67,121.541
Provenance & metadata (1)