Downloads · 30 days
13
2% of all-time downloads
pyg-13b-4bit-128g
4bit/pyg-13b-4bit-128g
pyg-13b-4bit-128g is a text generation model from 4bit. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.
All-time downloads
784
Public
Repo size
7.5 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors7.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- May 20, 2023
- Updated
- May 20, 2023
- SHA
- 9229ad76
Try a prompt
Model card
From the Hugging Face model README
pygmalion-13b-4bit-128g
Model description
Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.
Quantized from the decoded pygmalion-13b xor format. https://huggingface.co/PygmalionAI/pygmalion-13b
In safetensor format.
Quantization Information
GPTQ CUDA quantized with: https://github.com/0cc4m/GPTQ-for-LLaMa
python llama.py --wbits 4 models/pygmalion-13b c4 --true-sequential --groupsize 128 --save_safetensors models/pygmalion-13b/4bit-128g.safetensors
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Languages
- en
- Created
- May 20, 2023
- Updated
- May 20, 2023