Skip to content

win28703

Llama-3.1-Nemotron-70B-Instruct-HF-Q8-mlx

win28703/Llama-3.1-Nemotron-70B-Instruct-HF-Q8-mlx

Llama-3.1-Nemotron-70B-Instruct-HF-Q8-mlx is a text generation model from win28703. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.1.

The Model win28703/Llama-3.1-Nemotron-70B-Instruct-HF-Q8-mlx was converted to MLX format from nvidia/Llama-3.1-Nemotron-70B-Instruct-HF using mlx-lm version 0.19.1.

Downloads · 30 days

23

5% of all-time downloads

All-time downloads

471

Public

Parameters

70.6B

75 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors75 GB · 100%

Parameter types

How the weights are stored.

U3270.6B · 100%

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
llama
License
llama3.1
Languages
en
Created
Oct 21, 2024
Updated
Oct 21, 2024