Speed sweep

mistral-small-3-1-24b-instruct-2503-q4-k-m-apple-m3-ultra-512gb-llama-cpp-tp1-sweep

mistral-small-3-1-24b-instruct-2503-q4-k-m-apple-m3-ultra-512gb-llama-cpp-tp1-sweep

Record

Recipe: mistral-small-3-1-24b-instruct-2503-q4-k-m-apple-m3-ultra-512gb-llama-cpp-tp1
Measured: 2026-05-16T00:37:57.563Z
Points: 1

Measured speed

Concurrency	Context	Prefill	Decode	TTFT ms	Status
1	8,192	—	39.4	126	observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id: mistral-small-3-1-24b-instruct-2503-q4-k-m-apple-m3-ultra-512gb-llama-cpp-tp1-sweep
measured at: 2026-05-16T00:37:57.563Z
recipe id: mistral-small-3-1-24b-instruct-2503-q4-k-m-apple-m3-ultra-512gb-llama-cpp-tp1
schema version: local-ai-registry/v1

metrics

rows

concurrency	context tokens	decode tok s	decode tok s per stream	output tokens	peak vram gb	prefill tok s	samples
1	8,192	39.44	Unknown	512	Unknown	Unknown	1

Provenance & metadata (1)

source