Speed sweep

huihui-qwen3-6-27b-abliterated-q4-k-m-apple-m5-max-128gb-llama-cpp-tp1-sweep

huihui-qwen3-6-27b-abliterated-q4-k-m-apple-m5-max-128gb-llama-cpp-tp1-sweep

Record

Recipe
huihui-qwen3-6-27b-abliterated-q4-k-m-apple-m5-max-128gb-llama-cpp-tp1
Measured
2026-07-25T17:28:58.703Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
18,1927,761.926.271.6observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
huihui-qwen3-6-27b-abliterated-q4-k-m-apple-m5-max-128gb-llama-cpp-tp1-sweep
measured at
2026-07-25T17:28:58.703Z
recipe id
huihui-qwen3-6-27b-abliterated-q4-k-m-apple-m5-max-128gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
b10079
latest point at
2026-07-25T17:28:58.703Z
max context tokens
8,192
peak generation tps
26.23
peak prompt tps
7,761.86
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
18,19226.2326.23128Unknown7,761.861
Provenance & metadata (1)