Downloads · 30 days
0
0% of all-time downloads
riveRiPH/Forgotten-Abomination-12B-v4.0-EXL2
Forgotten-Abomination-12B-v4.0-EXL2 is a machine learning model from riveRiPH. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
<img src="https://i.imgur.com/ddasxmy.png" class="waifu-img" alt="Protocol Mascot"
Downloads · 30 days
0
0% of all-time downloads
All-time downloads
21
Public
Repo size
26.5 GB
Likes
0
Public
Click a slice to open those files.
.json2.2 MB · 100%
From the Hugging Face model README
This repository contains exl2 quants of Forgotten-Abomination-12B-v4.0, each in respective branch.
Built-in(default) calibration dataset is used.
To download, open directory you want to download to in your shell/CLI, then use huggingface-cli:
huggingface-cli download riveRiPH/Forgotten-Abomination-12B-v4.0-EXL2 --local-dir Forgotten-Abomination-12B-v4.0-6bpw-h8-exl2 --local-dir-use-symlinks False --revision 6bpw
huggingface-cli download riveRiPH/Forgotten-Abomination-12B-v4.0-EXL2 --local-dir Forgotten-Abomination-12B-v4.0-5bpw-h8-exl2 --local-dir-use-symlinks False --revision 5bpw
huggingface-cli download riveRiPH/Forgotten-Abomination-12B-v4.0-EXL2 --local-dir Forgotten-Abomination-12B-v4.0-4bpw-h8-exl2 --local-dir-use-symlinks False --revision 4bpw