Downloads · 30 days
278
13% of all-time downloads
wacomctl672/Nemotron-3-Nano-Omni-30B-Abliterated-MM-GGUF
Nemotron-3-Nano-Omni-30B-Abliterated-MM-GGUF is a machine learning model from wacomctl672. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
GGUF Quantizations for divinetribe/Nemotron-3-Nano-Omni-30B-Abliterated-MM-bf16
Downloads · 30 days
278
13% of all-time downloads
All-time downloads
2.2K
Public
Repo size
58.1 GB
Likes
2
Public
Click a slice to open those files.
.gguf58.1 GB · 100%
From the Hugging Face model README
GGUF Quantizations for divinetribe/Nemotron-3-Nano-Omni-30B-Abliterated-MM-bf16
tested multimodality with q8_0 mmproj from ggml-org
should run on anything that can run llama.cpp. tested under windows with cuda
Q4KM is 6.21 BPW because of fallback quantization. Q8_0 is the usual 8.51 BPW