Downloads · 30 days
119
7% of all-time downloads
HackerTwins/NVIDIA-Nemotron-Labs-3-Elastic-23B-A2.8B-GGUF
NVIDIA-Nemotron-Labs-3-Elastic-23B-A2.8B-GGUF is a text generation model from HackerTwins. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as other.
Tiny enough to squeeze onto real hardware. Big enough to be interesting.
Downloads · 30 days
119
7% of all-time downloads
All-time downloads
1.6K
Public
Repo size
31.6 GB
Likes
2
Public
Click a slice to open those files.
.gguf31.6 GB · 100%
From the Hugging Face model README
Tiny enough to squeeze onto real hardware. Big enough to be interesting.
This repo contains GGUF 4-bit quantized files for running NVIDIA Nemotron Labs 3 Elastic 23B A2.8B with llama.cpp-compatible runtimes.
| File | Best for | Rough memory target |
|---|---|---|
NVIDIA-Nemotron-Labs-3-Elastic-23B-A2.8B-Q4_K_S.gguf | Smaller 4-bit run | ~16GB VRAM/RAM |
NVIDIA-Nemotron-Labs-3-Elastic-23B-A2.8B-Q4_K_M.gguf | Better quality 4-bit run | ~20GB VRAM/RAM |
Use Q4_K_S if you are trying to make this thing fit on a 16GB GPU.
Use Q4_K_M if you have around 20GB+ available memory and want the better 4-bit quant.
Open LM Studio and search for:
HackerTwins/NVIDIA-Nemotron-Labs-3-Elastic-23B-A2.8B-GGUF
You can also paste this Hugging Face repo URL directly into LM Studio’s model search.