Skip to content

EliasOenal

Llama-3.1-Nemotron-70B-Instruct-W8A8-dynamic

EliasOenal/Llama-3.1-Nemotron-70B-Instruct-W8A8-dynamic

Llama-3.1-Nemotron-70B-Instruct-W8A8-dynamic is a text generation model from EliasOenal. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.1.

- Model Architecture: Llama-3.1-Nemotron-70B-Instruct-HF - Input: Text - Output: Text - Model Optimizations: - Weight quantization: INT8 - Activation quantization: INT8 - Release Date: 2/12/2025 - Version: 1.0 - Model…

Downloads · 30 days

21

11% of all-time downloads

All-time downloads

185

Public

Parameters

70.6B

72.7 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors72.7 GB · 100%

Parameter types

How the weights are stored.

I868.5B · 97%

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
llama
License
llama3.1
Languages
en
Created
Feb 12, 2025
Updated
Feb 12, 2025