Downloads · 30 days
11
2% of all-time downloads
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
PPO_Pygway-V8p4_Dev-6b-4bit-128g is a text generation model from mayaeary. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as unknown.
GPTQ quantization of https://huggingface.co/TehVenom/PPOPygway-V8p4Dev-6b
Downloads · 30 days
11
2% of all-time downloads
All-time downloads
576
Public
Repo size
4 GB
Likes
2
Public
Click a slice to open those files.
.safetensors4 GB · 100%
From the Hugging Face model README
GPTQ quantization of https://huggingface.co/TehVenom/PPO_Pygway-V8p4_Dev-6b
Using this repository: https://github.com/mayaeary/GPTQ-for-LLaMa/tree/gptj-v2
Command:
python3 gptj.py models/PPO_Pygway-V8p4_Dev-6b c4 --wbits 4 --groupsize 128 --save_safetensors models/PPO_Pygway-V8p4_Dev-6b-4bit-128g.safetensors