Speed sweep

nemotron-cascade-2-30b-a3b-gguf-q4-k-m-intel-arc-pro-b70-32gb-llama-cpp-tp1-sweep

nemotron-cascade-2-30b-a3b-gguf-q4-k-m-intel-arc-pro-b70-32gb-llama-cpp-tp1-sweep

Record

Recipe
nemotron-cascade-2-30b-a3b-gguf-q4-k-m-intel-arc-pro-b70-32gb-llama-cpp-tp1
Measured
2026-07-05T00:03:00.818Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
12,04850.9449.2observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
nemotron-cascade-2-30b-a3b-gguf-q4-k-m-intel-arc-pro-b70-32gb-llama-cpp-tp1-sweep
measured at
2026-07-05T00:03:00.818Z
recipe id
nemotron-cascade-2-30b-a3b-gguf-q4-k-m-intel-arc-pro-b70-32gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
inference engine version
fdb1db877c526ec90f668eca1b858da5dba85560
latest point at
2026-07-05T00:03:00.818Z
max context tokens
2,048
peak generation tps
50.904
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
12,04850.90450.904128UnknownUnknown1
Provenance & metadata (1)