Downloads · 30 days
9
3% of all-time downloads
BlackSheep-24B-GPTQ
GusPuffy/BlackSheep-24B-GPTQ
BlackSheep-24B-GPTQ is a text generation model from GusPuffy. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as artistic-2.0.
<p align="center" <img width="120px" alt="Sentient Simulations Plumbob" src="https://www.sentientsimulations.com/transparent-plumbob2.png" </p <p align="center"<a href="https://www.sentientsimulations.com/"[🏠Sentient…
All-time downloads
296
Public
Parameters
23.7B
14.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors14.1 GB · 100%
Parameter types
How the weights are stored.
I3222.2B · 94%
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
<p align="center">
<img width="120px" alt="Sentient Simulations Plumbob" src="https://www.sentientsimulations.com/transparent-plumbob2.png">
</p>
<p align="center"><a href="https://www.sentientsimulations.com/">[🏠Sentient Simulations]</a> | <a href="https://discord.com/invite/JTjbydmUAp">[Discord]</a> | <a href="https://www.patreon.com/SentientSims">[Patreon]</a>
<hr>
BlackSheep-24B-GPTQ
This repository contains a 4 bit GPTQ-quantized version of the TroyDoesAI/BlackSheep-24B model using llm-compressor.
Quantization Settings
| Attribute | Value |
|---|---|
| Algorithm | GPTQ |
| Layers | Linear |
| Weight Scheme | W4A16 |
| Group Size | 128 |
| Calibration Dataset | openerotica/erotiquant3 |
| Calibration Sequence Length | 4900 |
| Calibration Samples | 1024 |
Dataset Preprocessing
The dataset was preprocessed with the following steps:
- Extract and structure the conversation data using role-based templates (
SYSTEM,USER,ASSISTANT). - Convert the structured conversations into a tokenized format using the model's tokenizer.
- Filter out sequences shorter than 4096 tokens.
- Shuffle and select 512 samples for calibration.
Quantization Process
View the shell and python script used to quantize this model.
1 local 3090 128GB of ram.
Acknowledgments
- Base Model: TroyDoesAI/BlackSheep-24B
- Calibration Dataset: openerotica/erotiquant3
- LLM Compressor: llm-compressor
- Everyone subscribed to the Sentient Simulations Patreon
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- artistic-2.0
- Created
- Jul 19, 2025
- Updated
- Jul 19, 2025