Downloads · 30 days
30
5% of all-time downloads
pygmalion-13b-4bit-128g
JCTN/pygmalion-13b-4bit-128g
pygmalion-13b-4bit-128g is a text generation model from JCTN. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.
All-time downloads
639
Public
Repo size
7.5 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors7.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- May 26, 2023
- Updated
- May 26, 2023
- SHA
- 1f812e38
Try a prompt
Model card
From the Hugging Face model README
pygmalion-13b-4bit-128g
Model description
Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.
Quantized from the decoded pygmalion-13b xor format. https://huggingface.co/PygmalionAI/pygmalion-13b
In safetensor format.
Quantization Information
GPTQ CUDA quantized with: https://github.com/0cc4m/GPTQ-for-LLaMa
python llama.py --wbits 4 models/pygmalion-13b c4 --true-sequential --groupsize 128 --save_safetensors models/pygmalion-13b/4bit-128g.safetensors
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Languages
- en
- Created
- May 26, 2023
- Updated
- May 26, 2023