Downloads · 30 days
57
11% of all-time downloads
askmyteapot/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IQ4_XS
Meta-Llama-3-70B-Instruct-abliterated-v3.5-IQ4_XS is a machine learning model from askmyteapot. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.
This is just my IQ4XS quant of https://huggingface.co/failspy/Meta-Llama-3-70B-Instruct-abliterated-v3.5
Downloads · 30 days
57
11% of all-time downloads
All-time downloads
508
Public
Repo size
37.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf37.9 GB · 100%
From the Hugging Face model README
This is just my IQ4_XS quant of https://huggingface.co/failspy/Meta-Llama-3-70B-Instruct-abliterated-v3.5
Also included is my generated imatrix data file, generated on 200 x 2048 tokens of Wiki.Train.Raw against Q8_0 (i dont have enough RAM + VRAM to do the full fp16).