Downloads · 30 days
12
3% of all-time downloads
zatochu/llama-13b-pretrained-dropout-hf-int4-128g
llama-13b-pretrained-dropout-hf-int4-128g is a text generation model from zatochu. Use it when you need the model to write or continue text. It is set up for transformers.
https://wandb.ai/open-assistant/supervised-finetuning/runs/i9gmn0dt
Downloads · 30 days
12
3% of all-time downloads
All-time downloads
418
Public
Repo size
7.5 GB
Likes
1
Public
Click a slice to open those files.
.safetensors7.5 GB · 100%
From the Hugging Face model README
https://wandb.ai/open-assistant/supervised-finetuning/runs/i9gmn0dt
Trained with residual dropout 0.1
This is https://huggingface.co/dvruette/llama-13b-pretrained-dropout quantized to int4, groupsize 128.
Run in text-generation-webui with --wbits 4 and --groupsize 128.