Downloads · 30 days
13
3% of all-time downloads
ChanSung_Elina_33b-4bit
digitous/ChanSung_Elina_33b-4bit
ChanSung_Elina_33b-4bit is a text generation model from digitous. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
NOTE: Safetensor 4bit quant will be uploaded within the day. Cheers.
All-time downloads
457
Public
Repo size
16.9 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors16.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Apr 27, 2023
- Updated
- Apr 28, 2023
- SHA
- 25d26b8d
Try a prompt
Model card
From the Hugging Face model README
NOTE: Safetensor 4bit quant will be uploaded within the day. Cheers.
This is a GPTQ 4 bit quant of ChanSung's Elina 33b. This is a LlaMa based model; LoRA merged with latest transformers conversion. Quantized with GPTQ, --wbits 4 --act-order --true-sequential --save_safetensors c4.
128 groupsize was not used so those running this on a consumer GPU with 24GB VRAM can run it at full context (2048) without any risk of OOM.
Original LoRA: https://huggingface.co/LLMs/Alpaca-LoRA-30B-elina
Repo: https://huggingface.co/LLMs
Likely Author: https://huggingface.co/chansung
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Created
- Apr 27, 2023
- Updated
- Apr 28, 2023