Downloads · 30 days
16
6% of all-time downloads
orca_mini_3b_gptq_badtest
SinanAkkoyun/orca_mini_3b_gptq_badtest
orca_mini_3b_gptq_badtest is a text generation model from SinanAkkoyun. Use it when you need the model to write or continue text. It is set up for transformers.
This is a very bad attempt at quantizing 128g 4 bit with alpaca (in orca style prompt
All-time downloads
273
Public
Repo size
2.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Jul 16, 2023
- Updated
- Jul 16, 2023
- SHA
- 5a5afd31
Try a prompt
Model card
From the Hugging Face model README
This is a very bad attempt at quantizing 128g 4 bit with alpaca (in orca style prompt
python quantize_alpaca.py --pretrained_model_dir orca_mini_3b/ --bits 4 --group_size 128 --quantized_model_dir orca_mini_3b_gptq/ --save_and_reloa
Downloqd cleaned dataset first: https://github.com/gururise/AlpacaDataCleaned
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Jul 16, 2023
- Updated
- Jul 16, 2023