Downloads · 30 days
35
2% of all-time downloads
Goldlionren00/AEON-Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4-GGUF
AEON-Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4-GGUF is a machine learning model from Goldlionren00. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as other.
This repository contains a GGUF conversion of:
Downloads · 30 days
35
2% of all-time downloads
All-time downloads
1.7K
Public
Repo size
27.7 GB
Likes
1
Public
Click a slice to open those files.
.gguf27.7 GB · 100%
From the Hugging Face model README
This repository contains a GGUF conversion of:
AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4
AEON-Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4.gguf
mmproj-BF16.gguf
Text-only:
.\llama-server.exe `
-m "AEON-Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4.gguf" `
--host 0.0.0.0 `
--port 10000 `
-ngl 999 `
-c 32768 `
--flash-attn on
Multimodal:
.\llama-server.exe `
-m "AEON-Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4.gguf" `
--mmproj "mmproj-BF16.gguf" `
--host 0.0.0.0 `
--port 10000 `
-ngl 999 `
-c 32768 `
--flash-attn on
Notes
This GGUF was converted locally on Windows 11 Pro using a patched llama.cpp conversion workflow for NVFP4 compressed-tensors.
The main model was tested locally with llama.cpp-compatible runtime on RTX 5090.
Attribution
Original model:
AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4
Please check and follow the upstream model license and usage terms.