Downloads · 30 days
93
9% of all-time downloads
sandmanbuzz/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-MTP-gguf
Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-MTP-gguf is a machine learning model from sandmanbuzz. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as pddl.
Dude didn't have any quants and I appreciate his approach. Letting KLD go makes sense because we're literally trying to diverge. That's... the point.
Downloads · 30 days
93
9% of all-time downloads
All-time downloads
1K
Public
Repo size
46.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf46.1 GB · 100%
From the Hugging Face model README
Dude didn't have any quants and I appreciate his approach. Letting KLD go makes sense because we're literally trying to diverge. That's... the point.
So I whipped up a couple. MTP seems to still be working, which is nice. Doesn't do as much on AMD as I wish it did, but it still flies.
BTW, importance Quants are not great for MTP if those tensors get touched. You're better off just leaving them or squanching them down to Q8_0 at most. The importance matrices don't exercise enough of the speculator, it's just gonna gimp it.