Downloads ยท 30 days
174
7% of all-time downloads
wazimondo/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-GGUF
Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-GGUF is a image-text-to-text model from wazimondo. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
๐ฏ GGUF Conversion of the original AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-BF16
Downloads ยท 30 days
174
7% of all-time downloads
All-time downloads
2.5K
Public
Repo size
98.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf35.1 GB ยท 100%
From the Hugging Face model README
๐ฏ GGUF Conversion of the original AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-BF16
| File | Format | Size | Description |
|---|---|---|---|
Nemotron-3-Nano-Omni-AEON-Uncensored-BF16.gguf | BF16 | ~59GB | Full precision LLM weights |
Nemotron-3-Nano-Omni-AEON-Uncensored-Q6_K.gguf | Q6_K | ~32GB | Quantized LLM weights (recommended) |
mmproj-Nemotron-3-Nano-Omni-BF16.gguf | BF16 | ~1.5GB | Vision encoder projection |
MEMEM*EMEMEM*EMEMEM*EMEMEM*EMEMEM*EMEMEMEM*EMEMEMEME
M = Mamba2 (SSM)E = Expert (Mixture of Experts)* = Attention./llama-cli \
-m Nemotron-3-Nano-Omni-AEON-Uncensored-Q6_K.gguf \
-p "Hello, how are you?" \
-n 256
./llama-llava-cli \
-m Nemotron-3-Nano-Omni-AEON-Uncensored-Q6_K.gguf \
--mmproj mmproj-Nemotron-3-Nano-Omni-BF16.gguf \
--image image.jpg \
-p "Describe this image in detail."
| Step | Tool | Details |
|---|---|---|
| LLM Extraction | Python safetensors | Extracted language_model.* from omni checkpoint |
| GGUF Conversion | convert_hf_to_gguf.py | llama.cpp โ NemotronHForCausalLM โ BF16 GGUF |
| Quantization | llama-quantize | BF16 โ Q6_K |
| mmproj | convert_hf_to_gguf.py --mmproj | NemotronNanoV2VLModel โ ViT + projector โ BF16 |
This is a GGUF conversion only. All model weights originate from:
| Role | Entity |
|---|---|
| ๐ง Original Model | AEON-7 |
| ๐ Architecture | NVIDIA NemotronH |
| ๐ง GGUF Conversion | @hotdogs |
| ๐ ๏ธ Tools | llama.cpp by Georgi Gerganov & contributors |
๐ก Note: This repo contains only GGUF format files converted from the original AEON-7 model. For the original PyTorch/SafeTensors weights, please visit the source model.
This is an uncensored model. Use responsibly and in compliance with applicable laws and regulations.