Downloads · 30 days
49
4% of all-time downloads
batiai/Nemotron-3-Super-120B-A12B-GGUF
Nemotron-3-Super-120B-A12B-GGUF is a text generation model from batiai. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as other.
<p align="center" <a href="https://flow.bati.ai"<img src="https://img.shields.io/badge/BatiFlow-macOS%20AI%20Automation-blue?style=for-the-badge&logo=apple" alt="BatiFlow"</a <a href="https://ollama.com/batiai/nemotro…
Downloads · 30 days
49
4% of all-time downloads
All-time downloads
1.2K
Public
Repo size
123 GB
Likes
1
Public
Click a slice to open those files.
.gguf123 GB · 100%
From the Hugging Face model README
Quantizations of NVIDIA Nemotron 3 Super 120B-A12B (NemotronH MoE, hybrid Mamba+Attention) for high-end Mac (96GB+). Built and verified by BatiAI for BatiFlow.
ollama pull batiai/nemotron3-super:iq4
| Quant | Size | VRAM target | Recommended For |
|---|---|---|---|
| IQ3_XXS | 53GB | ~64GB | 96GB+ Mac (compact) |
| IQ4_XS | 62GB | ~75GB | 128GB Mac (recommended) |
| Your Mac RAM | IQ3_XXS (53GB) | IQ4_XS (62GB) |
|---|---|---|
| 64GB | ⚠️ Heavy swap | ❌ |
| 96GB | ✅ Fast | ⚠️ Tight |
| 128GB | ✅ | ✅ Recommended |
| 192GB+ | ✅ | ✅ Headroom |
| Model | Size | Active | Recommended Mac |
|---|---|---|---|
| Nano 30B-A3B | 17GB (iq4) | 3B | 32GB |
| Nano Omni text 30B-A3B | 17GB (iq4) | 3B | 32GB (reasoning-tuned) |
| Super 120B-A12B | 62GB (iq4) | 12B | 128GB |
NemotronH is NVIDIA's hybrid architecture combining Mamba state-space layers with standard attention:
| BatiAI | Third-party | |
|---|---|---|
| Source | Quantized from official NVIDIA weights | Re-quantized from other GGUFs |
| Tested on | Real Mac hardware | Often untested on consumer hardware |
| imatrix | ✅ Calibrated (200 chunks wikitext-2) | Standard or none |
| Tool Calling | ✅ Verified | Often untested |
imatrix --chunks 200 calibratedBatiFlow — free, on-device AI automation for Mac. 5MB app, 100% local, unlimited. 57+ built-in tools for calendar, notes, reminders, files, email, browser, messaging.
Quantized from nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16. License: NVIDIA Open Model License.