Downloads · 30 days
32
2% of all-time downloads
Casual-Autopsy/The-True-Abomination-24B-imat-GGUF
The-True-Abomination-24B-imat-GGUF is a text generation model from Casual-Autopsy. Use it when you need the model to write or continue text.
The following calabration datasets were used to make the imatrix file: - calibrationdatav3.txt - imatrix-rp-extended.txt
Downloads · 30 days
32
2% of all-time downloads
All-time downloads
1.3K
Public
Repo size
97.3 GB
Likes
3
Public
Click a slice to open those files.
.gguf97.3 GB · 100%
From the Hugging Face model README
The following calabration datasets were used to make the imatrix file:
./llama-imatrix -t 14 -c 2048 -b 1024 -ub 512 -f ../Datasets/imatrix_cal/bartowski_imatrix.text -ngl 8 -m ../Models/RP_Models/The-True-Abomination-24B-bf16.gguf -o ../Models/RP_Models/batowski_The-True-Abomination-24B-imatrix.dat --chunks 32
Avg. ppl. for Mistral-Small Models: ~5-6
./llama-imatrix -t 14 -c 8192 -b 2048 -ub 1024 -f ../Datasets/imatrix_cal/virt-io_imatrix.text -ngl 8 -m ../Models/RP_Models/The-True-Abomination-24B-bf16.gguf -o ../Models/RP_Models/virt-io_The-True-Abomination-24B-imatrix.dat --chunk 3 --chunks 17 --in-file ../Models/RP_Models/batowski_The-True-Abomination-24B-imatrix.dat
Avg. ppl. for Mistral-Small Models: ~3-4
./llama-imatrix -t 14 -c 8192 -b 2048 -ub 1024 -f ../Datasets/imatrix_cal/virt-io_imatrix.text -ngl 8 -m ../Models/RP_Models/The-True-Abomination-24B-bf16.gguf -o ../Models/RP_Models/virt-io_The-True-Abomination-24B-imatrix.dat --chunk 109 --in-file ../Models/RP_Models/virt-io_The-True-Abomination-24B-imatrix.dat
Avg. ppl. for Mistral-Small Models: ~2-3
./llama-imatrix -t 14 -c 1024 -b 512 -ub 256 -f ../Datasets/imatrix_cal/lewdiculous_imatrix.text -ngl 8 -m ../Models/RP_Models/The-True-Abomination-24B-bf16.gguf -o ../Models/RP_Models/The-True-Abomination-24B-imatrix.dat --chunks 32 --in-file ../Models/RP_Models/virt-io_The-True-Abomination-24B-imatrix.dat --in-file ../Models/RP_Models/batowski_The-True-Abomination-24B-imatrix.dat
Avg. ppl. for Mistral-Small Models: ~5-6