Downloads · 30 days
91
7% of all-time downloads
Zynerji/Ektome-Qwen3.6-27B-PristinelyUncensored-GGUF
Ektome-Qwen3.6-27B-PristinelyUncensored-GGUF is a machine learning model from Zynerji. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
converthftogguf.py exports the language decoder only. On this model it wrote 851 of 1185 tensors; the remaining 334 are the vision tower and live in mmproj-q27bvl-f16.gguf. Nothing in the converter's output says so —…
Downloads · 30 days
91
7% of all-time downloads
All-time downloads
1.2K
Public
Repo size
46 GB
Likes
0
Public
Click a slice to open those files.
.gguf46 GB · 100%
From the Hugging Face model README
| file | size | fits a 12 GiB card? |
|---|---|---|
q27b_vl-Q4_K_M.gguf | 15.4 GiB | no |
q27b_vl-IQ4_XS.gguf | 14.2 GiB | no |
q27b_vl-Q3_K_M.gguf | 12.4 GiB | no — just over |
mmproj-q27b_vl-f16.gguf | 0.87 GiB | required for vision |
convert_hf_to_gguf.py exports the language decoder only. On this model it wrote 851 of
1185 tensors; the remaining 334 are the vision tower and live in mmproj-q27b_vl-f16.gguf.
Nothing in the converter's output says so — it reports Model successfully exported and exits
zero. Load the mmproj alongside the main GGUF or the model is blind.
llama-cli -m q27b_vl-Q3_K_M.gguf --mmproj mmproj-q27b_vl-f16.gguf ...
None of these fit a 12 GiB GPU with room for KV cache; Q3_K_M is the closest and still exceeds it. A 27B on 12 GiB needs IQ3 or lower, which is untested here — low-bit quantisation of the Gated DeltaNet layers is exactly where this architecture has already surprised us once (see the parent card on GPTQ).
Receipts, method and caveats: see the bf16 parent.