Downloads · 30 days
58
8% of all-time downloads
ewchampion/Ternary-Bonsai-1.7B-TQ2_0-GGUF
Ternary-Bonsai-1.7B-TQ2_0-GGUF is a machine learning model from ewchampion. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Requantized from prism-ml/Ternary-Bonsai-1.7B-gguf's F16 baseline to GGML's native TQ20 ternary type (~2.06 bits/weight), using stock llama.cpp (tag b9498) — not PrismML's custom fork/packing.
Downloads · 30 days
58
8% of all-time downloads
All-time downloads
768
Public
Repo size
625 MB
Likes
1
Public
Click a slice to open those files.
.gguf625 MB · 100%
From the Hugging Face model README
Requantized from prism-ml/Ternary-Bonsai-1.7B-gguf's F16 baseline to GGML's native TQ2_0 ternary type (~2.06 bits/weight), using stock llama.cpp (tag b9498) — not PrismML's custom fork/packing.
Sanity-checked via llama-server's OpenAI-compatible endpoint on CPU (Metal has no TQ1_0/TQ2_0 matmul kernels at this llama.cpp version — this model must run with -ngl 0 / CPU-only until upstream adds Metal support):
<tool_call> format): pass, clean structured tool_calls output.License: Apache 2.0 (carried over from base model).