Downloads · 30 days
52
9% of all-time downloads
Earlychildhoodeducation/furina-qwen3.6-27b-merged-2.0-GGUF
furina-qwen3.6-27b-merged-2.0-GGUF is a machine learning model from Earlychildhoodeducation. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is a quantized GGUF version of the original model hutaobentao/furina-qwen3.6-27b-merged-2.0.
Downloads · 30 days
52
9% of all-time downloads
All-time downloads
607
Public
Parameters
26.9B
175 GB on disk
Likes
0
Public
Click a slice to open those files.
.gguf121 GB · 69%
From the Hugging Face model README
This is a quantized GGUF version of the original model hutaobentao/furina-qwen3.6-27b-merged-2.0.
The quantization was performed locally (compiled on Apple Silicon M3 Max) to provide the community with efficient, offline-ready files for local inference, as the original author stated they did not have the hardware resources to quantize it themselves.
This repository contains the model in GGUF format, which is ideal for CPU inference and Apple Metal / unified memory setups.
This repository contains the model in GGUF format, which is ideal for CPU inference and Apple Metal / unified memory setups.
This repository contains multiple GGUF variants to suit different hardware capabilities:
furina-qwen3.6-27b-f16.gguf (Uncompressed / 16-bit): The full-precision model converted directly from the Safetensors without any quality loss. It requires substantial unified memory/RAM (around 54 GB).furina-qwen3.6-27b-Q8_0.gguf (8-bit): Excellent quality, virtually indistinguishable from F16, but significantly smaller. Recommended if you have enough memory for it.furina-qwen3.6-27b-Q6_K.gguf (6-bit): A great high-end compromise, retaining almost all nuances of the model while being memory efficient.furina-qwen3.6-27b-Q4_K_M.gguf (4-bit): Recommended for most users. The standard choice for local inference. It strikes the best balance between small file size, very fast text generation, and almost unnoticeable quality degradation.You can use these GGUF files with any compatible local UI or CLI tool, such as:
Disclaimer: I am not the creator of the original model or the fine-tuning dataset. I only provide these GGUF files for the community to run the model locally.