Downloads · 30 days
257
20% of all-time downloads
apolo13x/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-DFlash-GGUF
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-DFlash-GGUF is a machine learning model from apolo13x. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
This is the GGUF conversion of NVIDIA's Nemotron 3.5 Lightning DFlash checkpoint.
Downloads · 30 days
257
20% of all-time downloads
All-time downloads
1.3K
Public
Repo size
1.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf1.2 GB · 100%
From the Hugging Face model README
This is the GGUF conversion of NVIDIA's Nemotron 3.5 Lightning DFlash checkpoint.
It must be paired with the original model. For example:
llama-server \
-hf ggml-org/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF:Q4_K_M \
-hfd apolo13x/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-DFlash-GGUF \
--spec-type draft-dflash \
-ngl all \
-ngld all \
-fa on \
--temp 1.0 \
--top-p 0.95
NVIDIA recommends temperature 1.0 and top-p 0.95.
This DFlash GGUF was obtained with llama.cpp b10373 by running:
python3 convert_hf_to_gguf.py \
dflash-hf \
--target-model-dir target-meta \
--outtype bf16 \
--outfile dflash-NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4.gguf