Downloads · 30 days
7
2% of all-time downloads
Ancestral/PPO_Shygmalion-6b-4bit-128g
PPO_Shygmalion-6b-4bit-128g is a text generation model from Ancestral. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
GPTQ quantization of https://huggingface.co/TehVenom/PPOShygmalion-6b
Downloads · 30 days
7
2% of all-time downloads
All-time downloads
432
Public
Repo size
4 GB
Likes
0
Public
Click a slice to open those files.
.safetensors4 GB · 100%
From the Hugging Face model README
GPTQ quantization of https://huggingface.co/TehVenom/PPO_Shygmalion-6b
Using this repository: https://github.com/mayaeary/GPTQ-for-LLaMa/tree/gptj-v2
Command:
python3 gptj.py models/PPO_Shygmalion-6b c4 --wbits 4 --groupsize 128 --save_safetensors models/PPO_Shygmalion-6b-4bit-128g.safetensors