Recipe

pg-prism-ml-bonsai-27b-gguf-bonsai-27b-q1-0-gguf-q1-0-apple-m4-max-36gb-llama-cpp-e8abf251d5

pg-prism-ml-bonsai-27b-gguf-bonsai-27b-q1-0-gguf-q1-0-apple-m4-max-36gb-llama-cpp-e8abf251d5

Measured compatibility from the local.ai Postgres publication. Launch arguments are not promoted into an executable contract.

Record

Status
candidate
Source
exo-postgres
Engine
llama.cpp
Engine version
9591 (62061f910)
Accelerators
1
Tensor parallel
1
Context tokens
90,048
Max concurrency
1
chat
unknown
reasoning
unknown
tools
unknown
vision
unknown

Hugging Face model card

Identity

https://huggingface.co/prism-ml/Bonsai-27B-gguf
Repository
prism-ml/Bonsai-27B-gguf
Status
known
Link type
Exact Hub repository

Public Hugging Face repository confirmed by the Hub API.

Candidate: useful compatibility or speed evidence. The registry does not offer Run until promotion requirements are met.

Observed configuration

llama.cpp

Evidence only · candidate · reference

Candidate evidence — not a Run contract

No tokenized launch fields. This is measured or documented compatibility, not a Docker launch.

Measured speed

ConcurrencyContextPrefillDecodeTTFT msStatusSweep
18,25638.3observedpg-019f682c-f0ce-7071-a5e1-39a730ec1ac5-sweep
132,83230.3observedpg-019f682c-f0ce-7071-a5e1-39a730ec1ac5-sweep
190,04814.3observedpg-019f682c-f0ce-7071-a5e1-39a730ec1ac5-sweep
132,768194,685.4observedpg-019f682c-f0ce-7071-a5e1-39a730ec1ac5-sweep
18,25638.4observedpg-019f682c-f0fe-7b93-912a-9642ad32189b-sweep
132,83230.2observedpg-019f682c-f0fe-7b93-912a-9642ad32189b-sweep
190,04814.3observedpg-019f682c-f0fe-7b93-912a-9642ad32189b-sweep
132,768195,608observedpg-019f682c-f0fe-7b93-912a-9642ad32189b-sweep
18,25639.2observedpg-019f9089-0e7f-7182-bee4-bae33aeb633f-sweep
132,83231observedpg-019f9089-0e7f-7182-bee4-bae33aeb633f-sweep
190,04814.4observedpg-019f9089-0e7f-7182-bee4-bae33aeb633f-sweep
132,768195,047.9observedpg-019f9089-0e7f-7182-bee4-bae33aeb633f-sweep
18,25639.2observedpg-019f90a9-88f4-72e4-aeef-38c94d0ae653-sweep
132,83231observedpg-019f90a9-88f4-72e4-aeef-38c94d0ae653-sweep
190,04814.4observedpg-019f90a9-88f4-72e4-aeef-38c94d0ae653-sweep
132,768195,047.9observedpg-019f90a9-88f4-72e4-aeef-38c94d0ae653-sweep
18,25639.2observedpg-019fd7b6-17bd-7c8c-b034-6d9e6bdce6d6-sweep
132,83231observedpg-019fd7b6-17bd-7c8c-b034-6d9e6bdce6d6-sweep
190,04814.4observedpg-019fd7b6-17bd-7c8c-b034-6d9e6bdce6d6-sweep
132,768195,047.9observedpg-019fd7b6-17bd-7c8c-b034-6d9e6bdce6d6-sweep
18,25638.3observedpg-01a011ee-ea06-7fc1-8420-b33071769545-sweep
132,83230.3observedpg-01a011ee-ea06-7fc1-8420-b33071769545-sweep
190,04814.3observedpg-01a011ee-ea06-7fc1-8420-b33071769545-sweep
132,768194,685.4observedpg-01a011ee-ea06-7fc1-8420-b33071769545-sweep
18,25638.4observedpg-01a011ee-ea31-74b7-b1d8-0d4150996e5b-sweep
132,83230.2observedpg-01a011ee-ea31-74b7-b1d8-0d4150996e5b-sweep
190,04814.3observedpg-01a011ee-ea31-74b7-b1d8-0d4150996e5b-sweep
132,768195,608observedpg-01a011ee-ea31-74b7-b1d8-0d4150996e5b-sweep

Remaining fields

Identity, launch, related records, and measured speed are shown above. This is the rest of the normalized record.

hardware count
1
hardware id
apple-m4-max-36gb
id
pg-prism-ml-bonsai-27b-gguf-bonsai-27b-q1-0-gguf-q1-0-apple-m4-max-36gb-llama-cpp-e8abf251d5
model instance id
prism-ml-bonsai-27b-gguf-bonsai-27b-q1-0-gguf--q1-0
recipe source
exo-postgres
schema version
local-ai-registry/v1
speed sweep ids
pg-019f682c-f0ce-7071-a5e1-39a730ec1ac5-sweep, pg-019f682c-f0fe-7b93-912a-9642ad32189b-sweep, pg-019f9089-0e7f-7182-bee4-bae33aeb633f-sweep, pg-019f90a9-88f4-72e4-aeef-38c94d0ae653-sweep, pg-019fd7b6-17bd-7c8c-b034-6d9e6bdce6d6-sweep, pg-01a011ee-ea06-7fc1-8420-b33071769545-sweep, pg-01a011ee-ea31-74b7-b1d8-0d4150996e5b-sweep
status
candidate

capabilities

engine

name
llama.cpp
version
9591 (62061f910)

serving

max concurrency
1
max context tokens
90,048
tensor parallel
1
Provenance & metadata (3)

facts

capabilities.chat · provenance · captured at
2026-08-27T06:04:13.773Z
capabilities.chat · reason capability-not-verified
capabilities.chat · state unknown
capabilities.reasoning · provenance · captured at
2026-08-27T06:04:13.773Z
capabilities.reasoning · reason capability-not-verified
capabilities.reasoning · state unknown
capabilities.tools · provenance · captured at
2026-08-27T06:04:13.773Z
capabilities.tools · reason capability-not-verified
capabilities.tools · state unknown
capabilities.vision · provenance · captured at
2026-08-27T06:04:13.773Z
capabilities.vision · reason capability-not-verified
capabilities.vision · state unknown
engine.graph mode · provenance · captured at
2026-08-27T06:04:13.773Z
engine.graph mode · reason runtime-detail-not-published
engine.graph mode · state unknown
serving.kv cache tokens · provenance · captured at
2026-08-27T06:04:13.773Z
serving.kv cache tokens · reason kv-cache-capacity-not-published
serving.kv cache tokens · state unknown

metadata

postgres · hardware key
m4_max_36_32c
postgres · publication id
pg-20260827T060320709Z
postgres · run count
7
postgres · source model id
prism-ml/Bonsai-27B-gguf/Bonsai-27B-Q1_0.gguf

provenance

captured at
2026-08-27T06:04:13.773Z

sources

captured atkindurl
2026-08-27T06:04:13.773Znormalized-recipelocal.ai