Downloads · 30 days
37
19% of all-time downloads
valendra/Ternary-Bonsai-2-27B-safetensors
Ternary-Bonsai-2-27B-safetensors is a text generation model from valendra. Use it when you need the model to write or continue text.
Experimental SafeTensors checkpoint for the Ternary Bonsai 2 27B text model. This repository contains the converted model weights together with the tokenizer, chat template, and configuration required by a compatible…
Downloads · 30 days
37
19% of all-time downloads
All-time downloads
194
Public
Parameters
6.7B
7.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors7.2 GB · 100%
How the weights are stored.
U86.7B · 100%
From the Hugging Face model README
Experimental SafeTensors checkpoint for the Ternary Bonsai 2 27B text model. This repository contains the converted model weights together with the tokenizer, chat template, and configuration required by a compatible runtime.
Bonsai2ForCausalLMqwen3_5_textquant_method: bonsai_ternary)chat_template.jinjaThe quantization configuration uses an automatic ternary target and a normalized Sylvester-Walsh-Hadamard transform with 1024-element blocks and explicit signs. The checkpoint is not a conventional BF16 or FP16 model.
This checkpoint is intended for research, runtime integration, and evaluation
of ternary model inference. It requires a runtime that implements the
Bonsai2ForCausalLM architecture and the bonsai_ternary quantization format.
The corresponding Valendra vLLM implementation is available at:
https://github.com/valendra-tech/vllm/pull/3
Use a compatible Valendra vLLM build and pass this repository as the model identifier, for example:
vllm serve valendra/Ternary-Bonsai-2-27B-safetensors
Standard Transformers installations may not load this checkpoint unless they provide the Bonsai2 model implementation and quantization support.
No training-data, fine-tuning, or safety-evaluation information is asserted by this model card. Review the license and usage terms of the upstream model before redistributing or deploying this artifact.