Downloads · 30 days
0
0% of all-time downloads
rAIfle/llama-3-70B-Instruct-abliterated-exl2
llama-3-70B-Instruct-abliterated-exl2 is a machine learning model from rAIfle. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
EXL2 quants of failspy/llama-3-70B-Instruct-abliterated
Downloads · 30 days
0
0% of all-time downloads
All-time downloads
5
Public
Repo size
331 GB
Likes
1
Public
Click a slice to open those files.
.json4.5 MB · 100%
From the Hugging Face model README
EXL2 quants of failspy/llama-3-70B-Instruct-abliterated
Branches:
main -- measurement.json2.25b6h -- 2.25bpw, 6bit lm_head3.5b6h -- 3.5bpw, 6bit lm_head3.75b6h -- 3.75bpw, 6bit lm_head4b6h -- 4bpw, 6bit lm_head4.5b6h -- 4.5bpw, 6bit lm_head4.65b6h -- 4.65bpw, 6bit lm_head6b6h -- 6bpw, 6bit lm_head8b8h -- 8bpw, 8bit lm_headNo rpcal for this one, just a normal batch of standard-settings exl2.