Downloads · 30 days
13
5% of all-time downloads
nkpz/serena-safe-gptq
serena-safe-gptq is a text generation model from nkpz. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
4-bit quantized files for lenbrocki/Serena-safe
Downloads · 30 days
13
5% of all-time downloads
All-time downloads
256
Public
Repo size
3.8 GB
Likes
0
Public
Click a slice to open those files.
.safetensors3.8 GB · 100%
From the Hugging Face model README
4-bit quantized files for lenbrocki/Serena-safe
This appears to be a virtual therapist model with the format
Client: Message
Therapist: Message
Quantized using GPTQ-for-LLaMa.
Command used to quantize: python llama.py /my/model/directory c4 --wbits 4 --true-sequential --act-order --save_safetensors /my/output/file.safetensors