Downloads · 30 days
21
4% of all-time downloads
Beinsezii/laguna-s-2.1-GGUF-HALO
laguna-s-2.1-GGUF-HALO is a machine learning model from Beinsezii. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as openmdw-1.1.
Update: I manually revised the chat template to change "<think" - "<think\n" to fix inconsistent reasoning initialization. New templated included as jinja and embedded in gguf.
Downloads · 30 days
21
4% of all-time downloads
All-time downloads
527
Public
Repo size
263 GB
Likes
0
Public
Click a slice to open those files.
.gguf87.8 GB · 100%
From the Hugging Face model README
Update: I manually revised the chat template to change "<think>" -> "<think>\n" to fix inconsistent reasoning initialization. New templated included as jinja and embedded in gguf.
Quant optimized for quality / speed on a Strix Halo 128GiB system. Possibly also beneficial on DGX Spark and similar systems.
Left more headroom on this quant to better utilize long ctx and eventual DFlas once supported.
Refer to the tensor types for a breakdown of quantization method.
See the GLM version for more details on theory and comparisons.