Downloads · 30 days
37
5% of all-time downloads
quant-mind/Huihui-Nex-N2-mini-abliterated-GGUF
Huihui-Nex-N2-mini-abliterated-GGUF is a image-text-to-text model from quant-mind. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF de huihui-ai/Huihui-Nex-N2-mini-abliterated (arch qwen35moe, MoE ~35B, multimodal), via llama.cpp.
Downloads · 30 days
37
5% of all-time downloads
All-time downloads
762
Public
Repo size
64.6 GB
Likes
0
Public
Click a slice to open those files.
.gguf43.2 GB · 100%
From the Hugging Face model README
GGUF de huihui-ai/Huihui-Nex-N2-mini-abliterated (arch qwen3_5_moe, MoE ~35B, multimodal), via llama.cpp.
Conversao corrigida: o
block_count(camada MTP/nextn fantasma) foi ajustado de 41 para 40 para o modelo carregar.
| Arquivo | O que e |
|---|---|
Huihui-Nex-N2-mini-abliterated-UD-Q4_K_XL.gguf | LLM texto Q4_K_M + imatrix (din., estilo Unsloth UD) |
Huihui-Nex-N2-mini-abliterated-Q4_K_M.gguf | LLM texto Q4_K_M padrao |
mmproj-Huihui-Nex-N2-mini-abliterated-f16.gguf | Projetor de visao (necessario p/ imagem) |
imatrix-Huihui-Nex-N2-mini-abliterated.dat | importance matrix (calibration_datav3) |
llama-server -m Huihui-Nex-N2-mini-abliterated-UD-Q4_K_XL.gguf \
--mmproj mmproj-Huihui-Nex-N2-mini-abliterated-f16.gguf -c 8192