Downloads · 30 days
5
2% of all-time downloads
marboga/RYS-Qwen3.5-27B-4x-Q4_K_M.gguf
RYS-Qwen3.5-27B-4x-Q4_K_M.gguf is a machine learning model from marboga. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
A fork of https://huggingface.co/dnhkng/RYS-Qwen3.5-27B-FP8-M . A single layer being added didn't work with llama.cpp, as Qwen3.5 uses fullattentioninterval = 4, expecting every 4th layer to be a full attention layer.
Downloads · 30 days
5
2% of all-time downloads
All-time downloads
280
Public
Repo size
17.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf17.5 GB · 100%
From the Hugging Face model README
A fork of https://huggingface.co/dnhkng/RYS-Qwen3.5-27B-FP8-M . A single layer being added didn't work with llama.cpp, as Qwen3.5 uses full_attention_interval = 4, expecting every 4th layer to be a full attention layer.
So I added 4 duplicate layers, 31-35, and made it a gguf.