Recipe

pg-unsloth-gemma-4-e4b-it-gguf-gemma-4-e4b-it-ud-q8-k-xl-gguf-ud-q8-k-xl-apple-m5-max-128gb-llama-cpp-b8a3f9aa9a

pg-unsloth-gemma-4-e4b-it-gguf-gemma-4-e4b-it-ud-q8-k-xl-gguf-ud-q8-k-xl-apple-m5-max-128gb-llama-cpp-b8a3f9aa9a

Measured compatibility from the local.ai Postgres publication. Launch arguments are not promoted into an executable contract.

Record

Status
candidate
Source
exo-postgres
Engine
llama.cpp
Accelerators
1
Tensor parallel
1
Context tokens
131,008
Max concurrency
1
chat
unknown
reasoning
unknown
tools
unknown
vision
unknown

Hugging Face model card

Identity

https://huggingface.co/unsloth/gemma-4-E4B-it-GGUF
Repository
unsloth/gemma-4-E4B-it-GGUF
Status
known
Link type
Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

No tokenized launch fields. This is measured or documented compatibility, not a Docker launch.

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatusSweep
18,25673observedpg-019f9089-40ca-7a0b-a4b5-d8bcef51c3ab-sweep
132,83263.7observedpg-019f9089-40ca-7a0b-a4b5-d8bcef51c3ab-sweep
1131,00842.2observedpg-019f9089-40ca-7a0b-a4b5-d8bcef51c3ab-sweep
132,76819,423.9observedpg-019f9089-40ca-7a0b-a4b5-d8bcef51c3ab-sweep
18,25673observedpg-019f9c8d-396b-79c9-99e8-d38d3938446d-sweep
132,83263.7observedpg-019f9c8d-396b-79c9-99e8-d38d3938446d-sweep
1131,00842.2observedpg-019f9c8d-396b-79c9-99e8-d38d3938446d-sweep
132,76819,423.9observedpg-019f9c8d-396b-79c9-99e8-d38d3938446d-sweep
18,25673observedpg-019fd7b6-25dd-77a5-bc59-85da9e4b00e1-sweep
132,83263.7observedpg-019fd7b6-25dd-77a5-bc59-85da9e4b00e1-sweep
1131,00842.2observedpg-019fd7b6-25dd-77a5-bc59-85da9e4b00e1-sweep
132,76819,423.9observedpg-019fd7b6-25dd-77a5-bc59-85da9e4b00e1-sweep
18,25673observedpg-01a03076-f7cd-78b3-9943-08a800c6a032-sweep
132,83263.7observedpg-01a03076-f7cd-78b3-9943-08a800c6a032-sweep
1131,00842.2observedpg-01a03076-f7cd-78b3-9943-08a800c6a032-sweep
132,76819,423.9observedpg-01a03076-f7cd-78b3-9943-08a800c6a032-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count
1
hardware id
apple-m5-max-128gb
id
pg-unsloth-gemma-4-e4b-it-gguf-gemma-4-e4b-it-ud-q8-k-xl-gguf-ud-q8-k-xl-apple-m5-max-128gb-llama-cpp-b8a3f9aa9a
model instance id
unsloth-gemma-4-e4b-it-gguf-gemma-4-e4b-it-ud-q8-k-xl-gguf--ud-q8-k-xl
recipe source
exo-postgres
schema version
local-ai-registry/v1
speed sweep ids
pg-019f9089-40ca-7a0b-a4b5-d8bcef51c3ab-sweep, pg-019f9c8d-396b-79c9-99e8-d38d3938446d-sweep, pg-019fd7b6-25dd-77a5-bc59-85da9e4b00e1-sweep, pg-01a03076-f7cd-78b3-9943-08a800c6a032-sweep
status
candidate

capabilities

engine

name
llama.cpp

serving

max concurrency
1
max context tokens
131,008
tensor parallel
1
Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at
2026-08-27T06:04:13.773Z
capabilities.chat · reason capability-not-verified
capabilities.chat · state unknown
capabilities.reasoning · provenance · captured at
2026-08-27T06:04:13.773Z
capabilities.reasoning · reason capability-not-verified
capabilities.reasoning · state unknown
capabilities.tools · provenance · captured at
2026-08-27T06:04:13.773Z
capabilities.tools · reason capability-not-verified
capabilities.tools · state unknown
capabilities.vision · provenance · captured at
2026-08-27T06:04:13.773Z
capabilities.vision · reason capability-not-verified
capabilities.vision · state unknown
engine.graph mode · provenance · captured at
2026-08-27T06:04:13.773Z
engine.graph mode · reason runtime-detail-not-published
engine.graph mode · state unknown
engine.version · provenance · captured at
2026-08-27T06:04:13.773Z
engine.version · reason runtime-detail-not-published
engine.version · state unknown
serving.kv cache tokens · provenance · captured at
2026-08-27T06:04:13.773Z
serving.kv cache tokens · reason kv-cache-capacity-not-published
serving.kv cache tokens · state unknown

metadata

postgres · hardware key
m5_max_128_40c
postgres · publication id
pg-20260827T060320709Z
postgres · run count
4
postgres · source model id
unsloth/gemma-4-E4B-it-GGUF/gemma-4-E4B-it-UD-Q8_K_XL.gguf

provenance

captured at
2026-08-27T06:04:13.773Z

sources

captured atkindurl
2026-08-27T06:04:13.773Znormalized-recipelocal.ai