Downloads · 30 days
516
12% of all-time downloads
Abiray/Qwen3.6-35B-A3B-Q3_K_M-GGUF
Qwen3.6-35B-A3B-Q3_K_M-GGUF is a image-text-to-text model from Abiray. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This repository contains the Q3KM GGUF format of the Qwen3.6-35B-A3B model.
Downloads · 30 days
516
12% of all-time downloads
All-time downloads
4.4K
Public
Repo size
20.4 GB
Likes
1
Public
Click a slice to open those files.
.gguf20.4 GB · 100%
From the Hugging Face model README
This repository contains the Q3_K_M GGUF format of the Qwen3.6-35B-A3B model.
These files were quantized by Abiray using llama.cpp to make the model accessible for consumer hardware and CPU-heavy environments.
I have processed this model into several different quantization formats. You can find them in my other repositories:
You can run this model locally using llama-cli from the llama.cpp project.
# Example command (adjust threads and context size to your machine)
./llama-cli -m Qwen3.6-35B-A3B-Q3_K_M.gguf -p "Your prompt here" -n 512 -t 8 -c 4096