Downloads · 30 days
10
16% of all-time downloads
rahtml/NVIDIA-Nemotron-Nano-12B-v2-NVFP4-KV
NVIDIA-Nemotron-Nano-12B-v2-NVFP4-KV is a machine learning model from rahtml. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
NVFP4 Quantized version of nvidia/NVIDIA-Nemotron-Nano-12B-v2. Both weights and KV cache quantized to NVFP4, requires NVFP4 KV cache support.
Downloads · 30 days
10
16% of all-time downloads
All-time downloads
63
Public
Parameters
6.8B
8.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors8.9 GB · 100%
How the weights are stored.
U85.5B · 73%
From the Hugging Face model README
NVFP4 Quantized version of nvidia/NVIDIA-Nemotron-Nano-12B-v2. Both weights and KV cache quantized to NVFP4, requires NVFP4 KV cache support.