Downloads · 30 days
22
2% of all-time downloads
noctrex/Qwen3.5-397B-A17B-MXFP4_MOE-GGUF
Qwen3.5-397B-A17B-MXFP4_MOE-GGUF is a image-text-to-text model from noctrex. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product.
These are quantizations of the model Qwen3.5-397B-A17B
Downloads · 30 days
22
2% of all-time downloads
All-time downloads
1.4K
Public
Repo size
225 GB
Likes
3
Trending 1
Click a slice to open those files.
.gguf225 GB · 100%
From the Hugging Face model README
These are quantizations of the model Qwen3.5-397B-A17B
mmproj file, the F32 version is recommended for best results.Read the guide from unsloth in order to set up the model's recommended settings:
Qwen3.5 - How to Run Locally Guide
The mainline standard is to use MXFP4 for the MoE tensors, and Q8 for the rest.
So I created a new variant, where the other tensors are BF16 instead of Q8.
On some architectures BF16 will be slower, but its the highest quality, essentialy its the original tensors from the model copied over unquantized.
This model here has been quantized like this.
As of 2026-03-03 the chat template has been updated, and is using the fixed version from unsloth.
If you don't want to download the model again, you can just update the chat template.