Speed sweep

mellum2-12b-a2-5b-thinking-q4-k-m-apple-m5-pro-24gb-llama-cpp-tp1-sweep

mellum2-12b-a2-5b-thinking-q4-k-m-apple-m5-pro-24gb-llama-cpp-tp1-sweep

Record

Recipe
mellum2-12b-a2-5b-thinking-q4-k-m-apple-m5-pro-24gb-llama-cpp-tp1
Measured
2026-07-01T10:41:11.892Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
14,2241,809.3112.3283observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
mellum2-12b-a2-5b-thinking-q4-k-m-apple-m5-pro-24gb-llama-cpp-tp1-sweep
measured at
2026-07-01T10:41:11.892Z
recipe id
mellum2-12b-a2-5b-thinking-q4-k-m-apple-m5-pro-24gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
latest point at
2026-07-01T10:41:11.892Z
max context tokens
4,224
peak generation tps
112.32
peak prompt tps
1,809.32
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
14,224112.32Unknown128Unknown1,809.321
Provenance & metadata (1)