Downloads · 30 days
624
6% of all-time downloads
avalon2244/Qwen3.5-4B-Claude-Opus-4.6-Distilled-GGUF
Qwen3.5-4B-Claude-Opus-4.6-Distilled-GGUF is a machine learning model from avalon2244. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This terribly named model was a quick finetune of Qwen3.5-4B on the nohurry/Opus-4.6-Reasoning-3000x-filtered dataset. It tends to have cleaner reasoning traces than the original Qwen3.5-4B, and is around as accurate.…
Downloads · 30 days
624
6% of all-time downloads
All-time downloads
10.2K
Public
Repo size
14.4 GB
Likes
9
Public
Click a slice to open those files.
.gguf11 GB · 100%
From the Hugging Face model README
This terribly named model was a quick finetune of Qwen3.5-4B on the nohurry/Opus-4.6-Reasoning-3000x-filtered dataset. It tends to have cleaner reasoning traces than the original Qwen3.5-4B, and is around as accurate. I haven't tested it, though. This model was finetuned and converted to GGUF format using Unsloth.
It's a bit inconsistent with reasoning. It's far less likely to enter endless loops, and is uses far fewer tokens than the original model. But it's still a 4B model that's been finetuned on one dataset, so it's not fantastic.
Example usage:
llama-cli -hf avalon2244/Qwen3.5-4B-Claude-Opus-4.6-Distilled-GGUF --jinjallama-mtmd-cli -hf avalon2244/Qwen3.5-4B-Claude-Opus-4.6-Distilled-GGUF --jinjaQwen3.5-4B.Q5_K_M.ggufQwen3.5-4B.Q8_0.ggufQwen3.5-4B.Q4_K_M.ggufQwen3.5-4B.BF16-mmproj.gguf
This was trained 2x faster with Unsloth
<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>