Downloads · 30 days
306
6% of all-time downloads
ayylmaonade/Qwen3.5-35B-A3B-UD-MXFP4-GGUF
Qwen3.5-35B-A3B-UD-MXFP4-GGUF is a machine learning model from ayylmaonade. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains a backup of the Qwen 3.5-35B-A3B model quantized using Unsloth MXFP4 quantization. This is a backup/archive of a specific quantization version.
Downloads · 30 days
306
6% of all-time downloads
All-time downloads
5.5K
Public
Repo size
21.3 GB
Likes
1
Public
Click a slice to open those files.
.gguf21.3 GB · 100%
From the Hugging Face model README
This repository contains a backup of the Qwen 3.5-35B-A3B model quantized using Unsloth MXFP4 quantization. This is a backup/archive of a specific quantization version.
This is an unsloth MXFP4 quantized version of the Qwen 3.5-35B-A3B model. This repository serves as a backup/archive of this specific quantization.
The primary/updated version of this model has been updated elsewhere. This repository is intentionally maintained as a stable backup copy of this specific unsloth MXFP4 quantization.
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "ayylmaonade/Qwen-3.5-35B-A3B-UD-MXFP4"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)
Important: When using this model for vision tasks, always prefer mmproj-F16.gguf over mmproj-F16-og-qwen3.5.gguf. The standard mmproj-F16.gguf was quantized with a newer version and provides superior performance compared to the older "OG" vision encoder.
⚠️ This is a backup version - if you need the most recent version, please check for the primary/updated repository.
This archive is maintained as-is to preserve the exact quantization without any modifications or updates.
Apache 2.0