Downloads · 30 days
3.5K
57% of all-time downloads
magnitudedev/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4-DFlash-GGUF
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4-DFlash-GGUF is a machine learning model from magnitudedev. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as other.
Native NVFP4 GGUF conversion of nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4-DFlash for use with Magnitude.
Downloads · 30 days
3.5K
57% of all-time downloads
All-time downloads
6.3K
Public
Repo size
2.4 GB
Likes
0
Public
Click a slice to open those files.
.gguf1.2 GB · 100%
From the Hugging Face model README
Native NVFP4 GGUF conversion of
nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4-DFlash
for use with Magnitude.
Converted with
llama.cpp
at revision 9b05354ec6fb58b4e665e9a39ebc40285c015638.
NVFP4ca3b2a765da43234524c0c83669b4f552e31f0f226c7afa509f133cfd050bc19dflash.attention.causal = false: the draft block uses bidirectional attention.dflash.sample_from_anchor = false: proposals come from mask rows, starting after the anchor.