Skip to content

stan-hua

Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W4A16-KV8

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W4A16-KV8

Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W4A16-KV8 is a machine learning model from stan-hua. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Downloads · 30 days

34

50% of all-time downloads

All-time downloads

68

Public

Parameters

8.1B

5.7 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors5.7 GB · 100%

Parameter types

How the weights are stored.

I327B · 86%

Type
llama
Created
Nov 5, 2024
Updated
Nov 5, 2024