Downloads · 30 days
7
1% of all-time downloads
Ternary-Bonsai-8B-unpacked
Jcfunk/Ternary-Bonsai-8B-unpacked
Ternary-Bonsai-8B-unpacked is a machine learning model from Jcfunk. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
FP16 safetensors (HuggingFace format) of the ternary Bonsai-8B model. This repo exists for users who want to run Ternary Bonsai with stock HuggingFace tooling or frameworks that don't yet support any of the packed ter…
All-time downloads
487
Public
Parameters
8.2B
16.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.4 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- May 28, 2026
- Updated
- May 28, 2026
- SHA
- 8efcd9ab
Model card
From the Hugging Face model README
Ternary-Bonsai-8B — Unpacked FP16 Safetensors
FP16 safetensors (HuggingFace format) of the ternary Bonsai-8B model. This repo exists for users who want to run Ternary Bonsai with stock HuggingFace tooling or frameworks that don't yet support any of the packed ternary format. The MLX 2-bit format is currently the only packed format available; more formats for other backends are coming soon.
We strongly recommend using the natively packed models instead. The packed format is where all the benefits of Bonsai come from — up to 9x memory reduction, 5x faster inference, and lower energy per token. This unpacked FP16 version is full-size and does not provide any of those advantages.
For the optimized ternary release model (recommended):
- Ternary-Bonsai-8B MLX 2-bit — Ternary MLX for Apple Silicon
- Type
- qwen3
- License
- apache-2.0
- Created
- May 28, 2026
- Updated
- May 28, 2026