Skip to content

medmekk

Meta-Llama-3-8B-torchao-int4_weight_only-gs_128

medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs_128

Meta-Llama-3-8B-torchao-int4_weight_only-gs_128 is a machine learning model from medmekk. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

This model is a quantized version of the original model meta-llama/Meta-Llama-3-8B. It has been quantized using int4weightonly quantization with torchao.

Downloads · 30 days

10

26% of all-time downloads

All-time downloads

39

Public

Repo size

4.8 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin4.8 GB · 100%

At a glance

Model type
llama
Access
Public
Created
Oct 22, 2024
Updated
Oct 22, 2024
SHA
ebe5ccbd

Base models

Type
llama
Created
Oct 22, 2024
Updated
Oct 22, 2024