Downloads · 30 days
505
8% of all-time downloads
Abiray/Qwen3.6-35B-A3B-heretic-Q4_K_M-GGUF
Qwen3.6-35B-A3B-heretic-Q4_K_M-GGUF is a image-text-to-text model from Abiray. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as other.
This repository hosts the dedicated Q4KM GGUF quantization of the tvall43/Qwen3.6-35B-A3B-heretic model.
Downloads · 30 days
505
8% of all-time downloads
All-time downloads
6.7K
Public
Repo size
24.8 GB
Likes
8
Public
Click a slice to open those files.
.gguf24.8 GB · 100%
From the Hugging Face model README
This repository hosts the dedicated Q4_K_M GGUF quantization of the tvall43/Qwen3.6-35B-A3B-heretic model.
This repository is designed for users who want to quickly download the recommended quantization without having to select from a larger multi-file repository.
📦 Looking for other quantizations? If you need different sizes (like Q3_K_M, Q8_0, etc.), please visit the main repository: [https://huggingface.co/Abiray/Qwen3.6-35B-A3B-heretic-GGUF).
You can run this model using the latest versions of llama.cpp (built via cmake).
To run inference via the command line:
./build/bin/llama-cli -m Qwen3.6-35B-A3B-heretic-Q4_K_M.gguf -p "Explain the concept of quantum entanglement." -n 512