Downloads · 30 days
9
60% of all-time downloads
rAIfle/Cat-Llama-3-70B-instruct-exl2
Cat-Llama-3-70B-instruct-exl2 is a machine learning model from rAIfle. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
9
60% of all-time downloads
All-time downloads
15
Public
Repo size
185 GB
Likes
1
Public
Click a slice to open those files.
.json4.5 MB · 100%
From the Hugging Face model README
EXL2 quants of Cat Llama-3 70B instruct
Other EXL2 quants: Cat Llama-3 70B instruct exl2
2.25 bits per weight
4.65 bits per weight
6.00 bits per weight
8.00 bits per weight