Downloads · 30 days
154
15% of all-time downloads
darkstarinitiative/AJAN-SIMIT-Ternary-Bonsai-Q2_0-GGUF
AJAN-SIMIT-Ternary-Bonsai-Q2_0-GGUF is a machine learning model from darkstarinitiative. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Q20 GGUF quantizations of Prism ML's Ternary-Bonsai model family, produced by DarkStar Initiative for the Ajan Simit offline mobile AI project (an on-device Android voice assistant).
Downloads · 30 days
154
15% of all-time downloads
All-time downloads
1.1K
Public
Repo size
15.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf15.9 GB · 100%
From the Hugging Face model README
Q2_0 GGUF quantizations of Prism ML's Ternary-Bonsai model family, produced by DarkStar Initiative for the Ajan Simit offline mobile AI project (an on-device Android voice assistant).
We did not train or create the base model. This repository contains only our own re-quantization of Prism ML's publicly released weights, done so the model is small enough to run entirely on-device on a phone.
llama-quantize from Prism ML's own fork, PrismML-Eng/llama.cpp
(prism branch) -- credited per their own model card's request.LICENSE.If you use the original Ternary-Bonsai model itself (not just this re-quantization), please cite Prism ML directly:
@techreport{ternarybonsai,
title = {Ternary Bonsai: 1.58-bit Language Models},
author = {Prism ML},
}
Only the quantization level and the file/repo naming:
AJAN-SIMIT- prefix marks these files as our own community re-quantization
and build, produced for the Ajan Simit app specifically -- not an official Prism ML release,
and not endorsed by Prism ML or the Qwen team.| File | Size |
|---|---|
AJAN-SIMIT-Ternary-Bonsai-1.7B-Q2_0.gguf | ~463 MB |
AJAN-SIMIT-Ternary-Bonsai-4B-Q2_0.gguf | ~1.07 GB |
AJAN-SIMIT-Ternary-Bonsai-8B-Q2_0.gguf | ~2.18 GB |
AJAN-SIMIT-Ternary-Bonsai-27B-Q2_0.gguf | ~8.25 GB |
Compatible with any recent llama.cpp-based inference engine. Q2_0 is a first-class quant
type in Prism ML's llama.cpp fork; mainline llama.cpp support may vary by version.