Downloads · 30 days
21
3% of all-time downloads
TxemAI/Qwen3.5-122B-A10B-Q6_K-GGUF
Qwen3.5-122B-A10B-Q6_K-GGUF is a text generation model from TxemAI. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as apache-2.0.
GGUF quantization of Qwen/Qwen3.5-122B-A10B optimized for local inference with llama.cpp.
Downloads · 30 days
21
3% of all-time downloads
All-time downloads
773
Public
Repo size
100 GB
Likes
1
Public
Click a slice to open those files.
.gguf100 GB · 100%
From the Hugging Face model README
GGUF quantization of Qwen/Qwen3.5-122B-A10B optimized for local inference with llama.cpp.
llama-cli \
-m Qwen3.5-122B-A10B-Q6_K.gguf \
-p "Your prompt here" \
-n 200
Q6_K preserves more of the original model quality at the cost of larger file size (~95GB vs 69GB). Use this if you have sufficient RAM and prioritize output quality over speed. For a smaller footprint, see Q4_K_M version.