Recipe

gemma-4-31b-q8-0-rtx-5090-32gb-llama-cpp-tp1

gemma-4-31b-q8-0-rtx-5090-32gb-llama-cpp-tp1

Observed LocalMaxxing leaderboard run. Evidence for compatibility, not an executable launch contract.

Record

Status
candidate
Source
localmaxxing
Engine
llama.cpp
Accelerators
1
Tensor parallel
1
Context tokens
2,048
chat
unknown
reasoning
unknown
tools
unknown
vision
unknown

Hugging Face model card

Identity

https://huggingface.co/google/gemma-4-31B-it
Repository
google/gemma-4-31B-it
Status
known
Link type
Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

Source
https://www.localmaxxing.com/en/runs/cmqvtbfc902z7qr013snr3okd

Observed source tokens

Mechanical split of the source command. Unverified against the engine CLI. The registry does not offer Run for this recipe.

  1. hf

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatusSweep
12,0481,50038250observedgemma-4-31b-q8-0-rtx-5090-32gb-llama-cpp-tp1-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count
1
hardware id
rtx-5090-32gb
id
gemma-4-31b-q8-0-rtx-5090-32gb-llama-cpp-tp1
model instance id
google-gemma-4-31b-it--q8-0
recipe source
localmaxxing
schema version
local-ai-registry/v1
speed sweep ids
gemma-4-31b-q8-0-rtx-5090-32gb-llama-cpp-tp1-sweep
status
candidate

capabilities

engine

name
llama.cpp

serving

max context tokens
2,048
tensor parallel
1
Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at
2026-08-30T09:10:02Z
capabilities.chat · reason capability-not-verified
capabilities.chat · state unknown
capabilities.reasoning · provenance · captured at
2026-08-30T09:10:02Z
capabilities.reasoning · reason capability-not-verified
capabilities.reasoning · state unknown
capabilities.tools · provenance · captured at
2026-08-30T09:10:02Z
capabilities.tools · reason capability-not-verified
capabilities.tools · state unknown
capabilities.vision · provenance · captured at
2026-08-30T09:10:02Z
capabilities.vision · reason capability-not-verified
capabilities.vision · state unknown
engine.graph mode · provenance · captured at
2026-08-30T09:10:02Z
engine.graph mode · reason runtime-detail-not-published
engine.graph mode · state unknown
serving.kv cache tokens · provenance · captured at
2026-08-30T09:10:02Z
serving.kv cache tokens · reason kv-cache-capacity-not-published
serving.kv cache tokens · state unknown
serving.max concurrency · provenance · captured at
2026-08-31T23:03:15Z
serving.max concurrency · reason server-capacity-not-evidenced
serving.max concurrency · state unknown

metadata

localmaxxing · backend
cpu
localmaxxing · batch size
1
localmaxxing · hardware label
RTX 5090
localmaxxing · observed command
hf
localmaxxing · run id
cmqvtbfc902z7qr013snr3okd
localmaxxing · tokenized · arguments
hf
localmaxxing · tokenized · fidelity
faithful

provenance

captured at
2026-08-30T09:10:02Z

sources

captured atkindurl
2026-08-30T09:10:02Znormalized-recipewww.localmaxxing.com/en/runs/cmqvtbfc902z7qr013snr3okd