Downloads · 30 days
133
5% of all-time downloads
TxemAI/Qwen3.5-122B-A10B-Q4_K_M-GGUF
Qwen3.5-122B-A10B-Q4_K_M-GGUF is a text generation model from TxemAI. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as apache-2.0.
GGUF quantization of Qwen/Qwen3.5-122B-A10B optimized for local inference with llama.cpp.
Downloads · 30 days
133
5% of all-time downloads
All-time downloads
2.6K
Public
Repo size
74.2 GB
Likes
1
Public
Click a slice to open those files.
.gguf74.2 GB · 100%
From the Hugging Face model README
GGUF quantization of Qwen/Qwen3.5-122B-A10B optimized for local inference with llama.cpp.
llama-cli \
-m Qwen3.5-122B-A10B-Q4_K_M.gguf \
-p "Your prompt here" \
-n 200
This is a Mixture of Experts model — 122B total parameters but only ~10B active per token, which explains the surprisingly fast inference speed. Ideal for users who want near-frontier performance on local hardware with sufficient RAM (minimum 80GB recommended).