Downloads · 30 days
234
0% of all-time downloads
pygmalion-13b-4bit-128g
notstoic/pygmalion-13b-4bit-128g
pygmalion-13b-4bit-128g is a text generation model from notstoic. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.
All-time downloads
58.6K
Public
Repo size
7.5 GB
Likes
150
Public
Repo makeup
Click a slice to open those files.
.safetensors7.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- May 18, 2023
- Updated
- May 18, 2023
- SHA
- eece8c41
Try a prompt
Spaces
Model card
From the Hugging Face model README
pygmalion-13b-4bit-128g
Model description
Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.
Quantized from the decoded pygmalion-13b xor format. https://huggingface.co/PygmalionAI/pygmalion-13b
In safetensor format.
Quantization Information
GPTQ CUDA quantized with: https://github.com/0cc4m/GPTQ-for-LLaMa
python llama.py --wbits 4 models/pygmalion-13b c4 --true-sequential --groupsize 128 --save_safetensors models/pygmalion-13b/4bit-128g.safetensors
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Languages
- en
- Created
- May 18, 2023
- Updated
- May 18, 2023