Downloads · 30 days
49
6% of all-time downloads
ChatMDE/Qwen3.5-4B-ChatMDE-v1.0-GGUF
Qwen3.5-4B-ChatMDE-v1.0-GGUF is a text generation model from ChatMDE. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
GGUF builds of ChatMDE v1.0, a persona fine-tune of Qwen/Qwen3.5-4B. A LoRA (rank 32) was trained on chat-formatted multi-turn conversations derived from public web-forum threads, merged into the base, and quantized f…
Downloads · 30 days
49
6% of all-time downloads
All-time downloads
839
Public
Repo size
12.7 GB
Likes
1
Public
Click a slice to open those files.
.gguf8.1 GB · 100%
From the Hugging Face model README
GGUF builds of ChatMDE v1.0, a persona fine-tune of
Qwen/Qwen3.5-4B. A LoRA (rank 32) was trained on
chat-formatted multi-turn conversations derived from public web-forum threads, merged into the
base, and quantized for CPU inference with llama.cpp.
Text-only. These are language-model GGUFs (converted --no-mtp); no vision/mmproj.
# llama.cpp server
llama-server -m Qwen3.5-4B-ChatMDE-v1.0-Q4_K_M.gguf --jinja -c 4096
# or llama-cpp-python
from llama_cpp import Llama
llm = Llama(model_path="Qwen3.5-4B-ChatMDE-v1.0-Q4_K_M.gguf", n_ctx=4096, n_threads=4)
--reasoning-budget 0 / an empty <think></think> block) unless you want the chain-of-thought.Stylized persona model for casual/creative chat and research. It is irreverent by design, can be
sarcastic or off-color, and is not a factual assistant — do not rely on it for accurate
information. Weights are Apache-2.0; use is also subject to the Qwen/Qwen3.5-4B base license.