Downloads · 30 days
23
3% of all-time downloads
baa-ai/Nemotron-3-Super-120B-A12B-MINT-GGUF
Nemotron-3-Super-120B-A12B-MINT-GGUF is a machine learning model from baa-ai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as other.
GGUF quantized version of nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 optimised by baa.ai.
Downloads · 30 days
23
3% of all-time downloads
All-time downloads
766
Public
Repo size
86.1 GB
Likes
2
Public
Click a slice to open those files.
.gguf86.1 GB · 100%
From the Hugging Face model README
GGUF quantized version of nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 optimised by baa.ai.
Hybrid Mamba-MoE-Attention architecture (512 experts, 22 active per token) — Q4_K_M quantized for llama.cpp.
| File | Quant | Size |
|------|-------|------|
| Nemotron-3-Super-120B-Q4_K_M.gguf | Q4_K_M | 80 GB |
| Metric | Value |
|--------|-------|
| Size | 80 GB |
| Quantization | Q4_K_M |
| Framework | llama.cpp (GGUF) |
| Architecture | Hybrid Mamba-2 + MoE + Attention |
| Parameters | 123.6B (12B active) |
llama-cli -m Nemotron-3-Super-120B-Q4_K_M.gguf \
-p "Hello!" -n 256 --threads 8
Requires llama.cpp build ≥ 8500 for NemotronH MoE + latent projection support
Peak memory: ~85 GB
MTP (Multi-Token Prediction) layers are stripped during conversion
Quantized by baa.ai
Black Sheep AI builds private AI with the Bounded AI Architecture (BAA): three layers, each bound to something you control, on infrastructure you control. Nothing leaves your boundary.
Ram (Reasoning Layer) — Full-capability frontier models, shrunk to fit smaller GPUs with reasoning kept and certified. They rely strictly on your Data Modules for knowledge, so you swap the model as better ones ship.
Paddock (Knowledge Plane) — Binds your Data Modules directly to the reasoning layer: one per topic, period, person, permission or tenant. Permission, freeze, hand back or delete each one on its own.
Watchman (GRC Layer) — Governance, risk and compliance in a single, complete audit log: every module permission, every bind, every model's provenance. Five certificates before anything goes live.
Shepherd — Takes a frontier model, compresses it into a Ram reasoning model, certifies it with Watchman, binds it to your Paddock, and deploys the Bounded AI Architecture to your infrastructure: your cloud, a Mac Studio, or an air-gapped facility.
Learn more at baa.ai — Private AI for enterprises whose data cannot leave the building.