Downloads · 30 days
166
2% of all-time downloads
Goldlionren00/AEON-Qwen3.6-27B-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS-GGUF
AEON-Qwen3.6-27B-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS-GGUF is a image-text-to-text model from Goldlionren00. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as apache-2.0.
This repository contains a GGUF conversion of:
Downloads · 30 days
166
2% of all-time downloads
All-time downloads
6.7K
Public
Repo size
19.7 GB
Likes
2
Public
Click a slice to open those files.
.gguf19.7 GB · 100%
From the Hugging Face model README
This repository contains a GGUF conversion of:
AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS
This is intended for local inference with llama.cpp-compatible runtimes, especially on NVIDIA Blackwell GPUs such as the RTX 5090.
| File | Purpose |
|---|---|
AEON-Qwen3.6-27B-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS.gguf | Main GGUF model |
mmproj-BF16.gguf | Multimodal / vision projector for image input |
Text-only usage only requires the main .gguf file.
Image input / multimodal usage requires both the main model and mmproj-BF16.gguf.
nvidia-modelopt NVFP4 + MTP-XSThe upstream model is an NVFP4 MTP-XS model. In the original Hugging Face / vLLM workflow, MTP speculative decoding is used through the modelopt runtime path.
This GGUF conversion is provided primarily for llama.cpp-compatible local inference. Depending on your runtime version, the model may run as a standard GGUF model even if the original source model contains MTP-related tensors. Use MTP-specific acceleration only if your runtime explicitly supports it for this GGUF format.
Using Hugging Face CLI:
hf download Goldlionren00/AEON-Qwen3.6-27B-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS-GGUF \
--local-dir ./AEON-Qwen3.6-27B-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS-GGUF
Download only the main model:
hf download Goldlionren00/AEON-Qwen3.6-27B-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS-GGUF \
AEON-Qwen3.6-27B-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS.gguf \
--local-dir ./AEON-GGUF
Download the vision projector:
hf download Goldlionren00/AEON-Qwen3.6-27B-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS-GGUF \
mmproj-BF16.gguf \
--local-dir ./AEON-GGUF
llama-server \
-m ./AEON-Qwen3.6-27B-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS.gguf \
--host 0.0.0.0 \
--port 10000 \
-ngl 999 \
-c 32768 \
--flash-attn on
llama-server \
-m ./AEON-Qwen3.6-27B-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS.gguf \
--mmproj ./mmproj-BF16.gguf \
--host 0.0.0.0 \
--port 10000 \
-ngl 999 \
-c 32768 \
--flash-attn on
.\llama-server.exe `
-m "F:\Models\gguf\AEON-Qwen3.6-27B-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS.gguf" `
--mmproj "F:\Models\gguf\mmproj-BF16.gguf" `
--host 0.0.0.0 `
--port 10000 `
-ngl 999 `
-c 32768 `
--flash-attn on
For text-only inference, remove the --mmproj line.
Start conservative:
-c 32768
If stable and there is enough VRAM headroom, try:
-c 65536
For very long context, monitor VRAM usage carefully. The maximum usable context depends on the runtime, KV-cache type, batch size, GPU memory, and whether multimodal input is enabled.
.gguf file in LM Studio.mmproj-BF16.gguf as the multimodal projector if it is not detected automatically.llama.cpp build with NVFP4 GGUF support.mmproj-BF16.gguf.This model was converted locally from the upstream AEON-7 NVFP4 MTP-XS model into GGUF format for llama.cpp-compatible runtimes.
The conversion was tested locally before upload.
Upstream source model:
AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS
Base model lineage:
Qwen/Qwen3.6-27B
Please refer to the upstream AEON-7 model card for full details about the original quantization recipe, MTP-XS design, calibration, provenance, and deployment guidance.
Apache-2.0, following the upstream model license.
This is an uncensored model. Users are responsible for downstream safety controls, moderation, logging, access control, and compliance with applicable laws and policies.
Do not deploy this model in high-risk or production environments without appropriate safeguards.