Downloads · 30 days
9
15% of all-time downloads
llmixer/Cat-Llama-3-70B-instruct-8.1bpw-h8-exl2
Cat-Llama-3-70B-instruct-8.1bpw-h8-exl2 is a text generation model from llmixer. Use it when you need the model to write or continue text. It is set up for transformers.
8.1 bpw exl2 quant of Cat-Llama-3-70B-instruct
Downloads · 30 days
9
15% of all-time downloads
All-time downloads
60
Public
Repo size
72.7 GB
Likes
0
Public
Click a slice to open those files.
.safetensors72.7 GB · 100%
From the Hugging Face model README
8.1 bpw exl2 quant of Cat-Llama-3-70B-instruct
More quants: https://huggingface.co/turboderp/Cat-Llama-3-70B-instruct-exl2