Downloads · 30 days
634
4% of all-time downloads
Ex0bit/Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM
Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM is a text generation model from Ex0bit. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
<p align="center"<img src="https://www.nvidia.com/content/nvidiaGDC/us/enUS/about-nvidia/legal-info/logo-brand-usage/jcrcontent/root/responsivegrid/nvcontainer392921705/nvcontainer/nvimage.coreimg.100.1070.png/1703060…
Downloads · 30 days
634
4% of all-time downloads
All-time downloads
16.4K
Public
Repo size
148 GB
Likes
30
Public
Click a slice to open those files.
.gguf148 GB · 100%
From the Hugging Face model README
Model Release Date: December 18, 2025
This model is an abliterated (uncensored) version of nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 that has had its refusal mechanisms removed using PRISM (Projected Refusal Isolation via Subspace Modification). The model will respond to prompts that the original model would refuse.
Key Specs: The model employs a hybrid Mixture-of-Experts (MoE) architecture, consisting of 23 Mamba-2 and MoE layers, along with 6 Attention layers. Each MoE layer includes 128 experts plus 1 shared expert, with 6 experts activated per token. The model has 3.5B active parameters and 30B parameters in total.
The supported languages include: English, German, Spanish, French, Italian, and Japanese. Improved using Qwen.
This model is ready for commercial use.
This project exists as research and development experimentation into understanding how large language models encode and enforce refusal behaviors, contributing to broader AI safety research by providing empirical data on refusal mechanism localization and tradeoffs between safety and capability.
Eric Elbaz (Ex0bit)
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 (Base Model)
└── Ex0bit/Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM (This Model)
├── Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM-BF16.gguf
├── Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM-Q8_0.gguf
├── Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM-Q6_K.gguf
└── Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM-IQ4_XS.gguf
| Quantization | Size | Description |
|---|---|---|
| BF16 | 63 GB | Full precision, best quality |
| Q8_0 | 34 GB | 8-bit, near-lossless quality |
| Q6_K | 34 GB | 6-bit k-quant, excellent quality |
| IQ4_XS | 18 GB | Importance-weighted 4-bit, great quality/size ratio |
The IQ4_XS quantization uses importance-weighted quantization which provides better quality than standard Q4 quantizations at similar sizes.
This model uses the Nemotron chat format with thinking/reasoning support:
<|im_start|>system
{system_prompt}<|im_end|>
<|im_start|>user
{user_prompt}<|im_end|>
<|im_start|>assistant
| Component | Token/Format |
|---|---|
| System Start | <|im_start|>system |
| User Start | <|im_start|>user |
| Assistant Start | <|im_start|>assistant |
| End of Turn | <|im_end|> |
| Thinking Start | <think> |
| Thinking End | </think> |
# Download the model
huggingface-cli download Ex0bit/Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM \
Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM-IQ4_XS.gguf \
--local-dir .
# Run inference
./llama-cli -m Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM-IQ4_XS.gguf \
-p "<|im_start|>user
Your prompt here<|im_end|>
<|im_start|>assistant
" \
-n 2048 \
--temp 0.7 \
-ngl 999
# Start the server
./llama-server -m Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM-IQ4_XS.gguf \
--host 0.0.0.0 \
--port 8080 \
-ngl 999 \
-c 32768
# Example API call
curl http://localhost:8080/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"messages": [
{"role": "user", "content": "Your prompt here"}
],
"temperature": 0.7
}'
# Pull and run directly from Hugging Face
ollama pull hf.co/Ex0bit/Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM
ollama run hf.co/Ex0bit/Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM
Note: The
hf.co/prefix is required to pull from Hugging Face. Requires Ollama 0.3.0+.
The model was abliterated using PRISM - a state-of-the-art abliteration methodology combining multiple principled techniques for effective refusal removal while preserving model capabilities.
| Quantization | Min VRAM | Recommended | Hardware Examples |
|---|---|---|---|
| IQ4_XS | 12 GB | 16+ GB | RTX 4090, A100, Apple M2/M3/M4 Pro/Max |
| Q6_K | 24 GB | 32+ GB | RTX 4090, A100 40GB, Apple M3/M4 Max |
| Q8_0 | 24 GB | 32+ GB | RTX 4090, A100 40GB, Apple M3/M4 Max |
| BF16 | 64 GB | 80+ GB | A100 80GB, H100, Multi-GPU setups |
Note: The IQ4_XS quantization runs well on consumer hardware with 16GB+ VRAM.
This model has been modified to reduce safety guardrails. Users are responsible for:
NVIDIA Open Model License (same as base model nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16)
@misc{elbaz2025nemotronprism,
author = {Elbaz, Eric},
title = {Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM: An Abliterated Nemotron Hybrid Model},
year = {2025},
publisher = {Hugging Face},
howpublished = {\url{https://huggingface.co/Ex0bit/Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM}}
}
Created by: Ex0bit (Eric Elbaz)