Speed sweep

mistral-small-24b-base-2501-q4-k-m-rtx-3090-24gb-llama-cpp-tp1-sweep

mistral-small-24b-base-2501-q4-k-m-rtx-3090-24gb-llama-cpp-tp1-sweep

Record

Recipe
mistral-small-24b-base-2501-q4-k-m-rtx-3090-24gb-llama-cpp-tp1
Measured
2026-07-19T21:11:24.102Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
11,0241,698.339.5observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
mistral-small-24b-base-2501-q4-k-m-rtx-3090-24gb-llama-cpp-tp1-sweep
measured at
2026-07-19T21:11:24.102Z
recipe id
mistral-small-24b-base-2501-q4-k-m-rtx-3090-24gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
latest point at
2026-07-19T21:11:24.102Z
max context tokens
1,024
peak generation tps
39.5
peak prompt tps
1,698.3
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
11,02439.539.5128Unknown1,698.31
Provenance & metadata (1)