Speed sweep

nvidia-nemotron-3-nano-4b-bf16-q4-k-m-rtx-3060-12gb-llama-cpp-tp1-sweep

nvidia-nemotron-3-nano-4b-bf16-q4-k-m-rtx-3060-12gb-llama-cpp-tp1-sweep

Record

Recipe
nvidia-nemotron-3-nano-4b-bf16-q4-k-m-rtx-3060-12gb-llama-cpp-tp1
Measured
2026-07-02T16:18:06.082Z
Points
1

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
14,0962,34089.7219observed

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

id
nvidia-nemotron-3-nano-4b-bf16-q4-k-m-rtx-3060-12gb-llama-cpp-tp1-sweep
measured at
2026-07-02T16:18:06.082Z
recipe id
nvidia-nemotron-3-nano-4b-bf16-q4-k-m-rtx-3060-12gb-llama-cpp-tp1
schema version
local-ai-registry/v1

metrics

concurrency
1
latest point at
2026-07-02T16:18:06.082Z
max context tokens
4,096
peak generation tps
89.68
peak prompt tps
2,339.97
point count
1

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
14,09689.68Unknown1284.672,339.971
Provenance & metadata (1)