Qwen3.5-4b-Coyote-GGUF

Qwen3.5-4b-Coyote (GGUF)

GGUF quantizations of Qwen3.5-4b-Coyote — a coding assistant fine-tuned for code generation, bug detection, and tool calling.

• Base model: Qwen/Qwen3.5-4B-Base (4.21B text backbone)
• Trained by: Michael Anthony Falabella
• Method: LoRA fine-tune (bf16, rank 16), merged into the base model
• Format: All files below are GGUF (llama.cpp / Ollama / LM Studio compatible)

Available models (quantizations)

Architecture qwen35, 32 transformer blocks, 426 tensors, 248,320-token vocabulary.

Quick start

Ollama

ollama create qwen3.5-4b-coyote -f Modelfile

with a Modelfile containing:

FROM ./qwen-3.5-4b-Coyote.Q8_0.gguf

Then:

ollama run qwen3.5-4b-coyote

llama.cpp

./llama-cli -m qwen-3.5-4b-Coyote.Q8_0.gguf -p "Write a Python function that ..." -cnv

Benchmarks

Evaluated on the BenchLocal coding benchpacks (as of the latest release):

License

Apache 2.0 — inherits the base model license. See Qwen/Qwen3.5-4B-Base for the underlying model license and terms.