Downloads · 30 days
4
25% of all-time downloads
riveRiPH/Forgotten-Abomination-8B-V2.2-EXL2
Forgotten-Abomination-8B-V2.2-EXL2 is a machine learning model from riveRiPH. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as other.
This repository contains exl2 quants of Forgotten-Abomination-8B-V2.2, each in respective branch.
Downloads · 30 days
4
25% of all-time downloads
All-time downloads
16
Public
Repo size
26.4 GB
Likes
0
Public
Click a slice to open those files.
.json2 MB · 100%
From the Hugging Face model README
This repository contains exl2 quants of Forgotten-Abomination-8B-V2.2, each in respective branch.
Built-in(default) calibration dataset is used.
To download, open directory you want to download to in your shell/CLI, then use huggingface-cli:
huggingface-cli download riveRiPH/Forgotten-Abomination-8B-V2.2-EXL2 --local-dir Forgotten-Abomination-8B-V2.2-EXL2 --local-dir-use-symlinks False --revision 8bpw
huggingface-cli download riveRiPH/Forgotten-Abomination-8B-V2.2-EXL2 --local-dir Forgotten-Abomination-8B-V2.2-EXL2 --local-dir-use-symlinks False --revision 6bpw
huggingface-cli download riveRiPH/Forgotten-Abomination-8B-V2.2-EXL2 --local-dir Forgotten-Abomination-8B-V2.2-EXL2 --local-dir-use-symlinks False --revision 5bpw
huggingface-cli download riveRiPH/Forgotten-Abomination-8B-V2.2-EXL2 --local-dir Forgotten-Abomination-8B-V2.2-EXL2 --local-dir-use-symlinks False --revision 4bpw