Downloads · 30 days
72
13% of all-time downloads
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-5GB
inference-snaps/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-5GB
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-5GB is a machine learning model from inference-snaps. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
The NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 model, quantized to Q4KM and split into 5GB GGUF files.
All-time downloads
545
Public
Repo size
47.9 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf47.9 GB · 100%
At a glance
- Access
- Public
- Created
- Aug 11, 2026
- Updated
- Sep 21, 2026
- SHA
- 6bae25c3
Base models
Model card
From the Hugging Face model README
Nemotron 3.5 Lightning 30B A3B 5GB
Q4_K_M
The NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 model, quantized to Q4_K_M and split into 5GB GGUF files.
The model has been split using llama-gguf-split (b10237) as follows:
llama-gguf-split --split-max-size 5G NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Q4_K_M.gguf NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Q4_K_M
NVFP4
The NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4 model, split into 5GB GGUF files.
llama-gguf-split --split-max-size 5G NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4.gguf NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4
- Created
- Aug 11, 2026
- Updated
- Sep 21, 2026