Downloads · 30 days
170
7% of all-time downloads
HackerTwins/NVIDIA-Nemotron-Labs-3-Elastic-12B-A2B-GGUF
NVIDIA-Nemotron-Labs-3-Elastic-12B-A2B-GGUF is a text generation model from HackerTwins. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as other.
A smaller, hacker-friendly GGUF build of NVIDIA Nemotron Elastic.
Downloads · 30 days
170
7% of all-time downloads
All-time downloads
2.4K
Public
Repo size
18.3 GB
Likes
2
Public
Click a slice to open those files.
.gguf18.3 GB · 100%
From the Hugging Face model README
A smaller, hacker-friendly GGUF build of NVIDIA Nemotron Elastic.
Built for llama.cpp, LM Studio, and other GGUF-compatible runtimes.
| File | Notes | Rough VRAM target |
|---|---|---|
nemotron-elastic-12b-Q4_K_S.gguf | Smaller 4-bit quant | ~10GB VRAM |
nemotron-elastic-12b-Q4_K_M.gguf | Better 4-bit quant | ~10GB+ VRAM |
Use Q4_K_S if you want the easier/smaller 4-bit file.
Use Q4_K_M if you want the better-quality 4-bit file and have a little more room.
Both files are intended for roughly 10GB VRAM class hardware, depending on context size, KV cache settings, and GPU offload.
Open LM Studio and search for:
HackerTwins/NVIDIA-Nemotron-Labs-3-Elastic-23B-A2.8B-GGUF