Skip to content

Avarok

nvidia-nemotron-nano-12b-v2-q4_k_m

Avarok/nvidia-nemotron-nano-12b-v2-q4_k_m

nvidia-nemotron-nano-12b-v2-q4_k_m is a machine learning model from Avarok. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as other.

This repository provides a 4-bit quantized GGUF build of NVIDIA Nemotron Nano 12B v2 using Q4KM, reducing the on-disk size to approximately 7GB from roughly 23GB for the original full precision weights, while preservi…

Downloads · 30 days

65

6% of all-time downloads

All-time downloads

1.2K

Public

Repo size

7.5 GB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf7.5 GB · 100%

At a glance

Library
llama.cpp
License
other
Access
Public
Created
Nov 3, 2025
Updated
Nov 3, 2025
SHA
e6bc38f8

Base models

Library
llama.cpp
License
other
Created
Nov 3, 2025
Updated
Nov 3, 2025