Downloads · 30 days
13
27% of all-time downloads
rahtml/NVIDIA-Nemotron-Nano-12B-v2-NVFP4
NVIDIA-Nemotron-Nano-12B-v2-NVFP4 is a machine learning model from rahtml. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
Model quantized using TensorRT-Model-Optimizer. Model quantized to NVFP4 format with KV cache quantized to FP8 format for compatibility.
Downloads · 30 days
13
27% of all-time downloads
All-time downloads
49
Public
Parameters
6.8B
8.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors8.9 GB · 100%
How the weights are stored.
U85.5B · 73%
From the Hugging Face model README
Model quantized using TensorRT-Model-Optimizer. Model quantized to NVFP4 format with KV cache quantized to FP8 format for compatibility.