Speed sweep

gemma-4-12b-it-exl3-4bpw-rtx4090-tabbyapi-tp1-sweep

gemma-4-12b-it-exl3-4bpw-rtx4090-tabbyapi-tp1-sweep

Record

Recipe
gemma-4-12b-it-exl3-4bpw-rtx4090-tabbyapi-tp1
Measured
2026-08-24
Accepted
2026-08-24
Points
3

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatus
1130,5602,204.974.759,240.8accepted
2130,5601,121.764.2116,398.9accepted
4130,560565.849.6230,771.3accepted

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

accepted at
2026-08-24
id
gemma-4-12b-it-exl3-4bpw-rtx4090-tabbyapi-tp1-sweep
measured at
2026-08-24
recipe id
gemma-4-12b-it-exl3-4bpw-rtx4090-tabbyapi-tp1
schema version
local-ai-registry/v1

metrics

concurrency
4
latest point at
2026-08-24
max context tokens
130,560
peak prompt tps
2,204.9
point count
3

rows

concurrencycontext tokensdecode tok sdecode tok s per streamoutput tokenspeak vram gbprefill tok ssamples
1130,560Unknown74.74512Unknown2,204.92
2130,560Unknown64.22512Unknown1,121.672
4130,560Unknown49.58512Unknown565.762
Provenance & metadata (1)

source

commit
a511aa89ed61cc68730af9943206cfe312208d57
paths
campaigns/runpod-gemma4-12b-2026-08-24/protocol.md, campaigns/runpod-gemma4-12b-2026-08-24/results.csv, campaigns/runpod-gemma4-12b-2026-08-24/artifacts/rtx-4090-24gb