Skip to content

BareMetalAI

Llama-3.1-Nemotron-Nano-8B-W4A16-AWQ

BareMetalAI/Llama-3.1-Nemotron-Nano-8B-W4A16-AWQ

Llama-3.1-Nemotron-Nano-8B-W4A16-AWQ is a text generation model from BareMetalAI. Use it when you need the model to write or continue text. It is set up for tensorrt-llm. The card lists the license as other.

Downloads · 30 days

9

3% of all-time downloads

All-time downloads

259

Public

Parameters

4.6B

5.8 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors5.8 GB · 100%

Parameter types

How the weights are stored.

U83.5B · 76%

Try a prompt

Base models

Task
Text Generation
Library
tensorrt-llm
Type
llama
License
other
Created
Jun 12, 2026
Updated
Jun 12, 2026