Downloads · 30 days
89
7% of all-time downloads
ilintar/NVIDIA-Nemotron-Nano-9B-v2-GGUF
NVIDIA-Nemotron-Nano-9B-v2-GGUF is a machine learning model from ilintar. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
IMatrix GGUFs calibrated on https://huggingface.co/datasets/eaddario/imatrix-calibration/tree/main combinedallsmall set.
Downloads · 30 days
89
7% of all-time downloads
All-time downloads
1.2K
Public
Repo size
48.8 GB
Likes
1
Public
Click a slice to open those files.
.gguf48.8 GB · 100%
From the Hugging Face model README
IMatrix GGUFs calibrated on https://huggingface.co/datasets/eaddario/imatrix-calibration/tree/main combined_all_small set.
Note: Due to the nonstandard tensor sizes, some quantization types do not make sense. For example, due to fallbacks IQ2_M is just 300MB smaller than IQ4_NL. Thus, I only upload the quantizations that actually made sense.