Downloads · 30 days
9
17% of all-time downloads
pygmalion-13b-4bit-128g-AutoGPTQ
usamakenway/pygmalion-13b-4bit-128g-AutoGPTQ
pygmalion-13b-4bit-128g-AutoGPTQ is a text generation model from usamakenway. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.
All-time downloads
52
Public
Repo size
7.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Jun 27, 2023
- Updated
- Jun 27, 2023
- SHA
- a4ddf36e
Try a prompt
Model card
From the Hugging Face model README
pygmalion-13b-4bit-128g
Model description
Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.
Quantized from the decoded pygmalion-13b xor format. https://huggingface.co/PygmalionAI/pygmalion-13b
In safetensor format.
Quantization Information
GPTQ CUDA quantized with: https://github.com/0cc4m/GPTQ-for-LLaMa
python llama.py --wbits 4 models/pygmalion-13b c4 --true-sequential --groupsize 128 --save_safetensors models/pygmalion-13b/4bit-128g.safetensors
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Languages
- en
- Created
- Jun 27, 2023
- Updated
- Jun 27, 2023