Skip to content

medmekk

Llama-3.1-70B-torchao-int8_weight_only

medmekk/Llama-3.1-70B-torchao-int8_weight_only

Llama-3.1-70B-torchao-int8_weight_only is a machine learning model from medmekk. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

This model is a quantized version of the original model meta-llama/Llama-3.1-70B. It has been quantized using int8weightonly quantization with torchao.

Downloads · 30 days

7

19% of all-time downloads

All-time downloads

36

Public

Repo size

82.1 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin82.1 GB · 100%

At a glance

Model type
llama
Access
Public
Created
Oct 8, 2024
Updated
Oct 8, 2024
SHA
26d7b957

Base models

Type
llama
Created
Oct 8, 2024
Updated
Oct 8, 2024