Downloads · 30 days
7
2% of all-time downloads
VicUnlocked-30B-gptq-cuda
QMB15/VicUnlocked-30B-gptq-cuda
VicUnlocked-30B-gptq-cuda is a text generation model from QMB15. Use it when you need the model to write or continue text. It is set up for transformers.
Made by merging the following lora: https://huggingface.co/Neko-Institute-of-Science/VicUnLocked-30b-LoRA
All-time downloads
366
Public
Repo size
16.9 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors16.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- May 18, 2023
- Updated
- May 18, 2023
- SHA
- 417b435f
Try a prompt
Model card
From the Hugging Face model README
Made by merging the following lora: https://huggingface.co/Neko-Institute-of-Science/VicUnLocked-30b-LoRA
Then quantizing with ooba's old CUDA branch of GPTQ
python llama.py vicunlocked-30b c4 --wbits 4 --true-sequential --act-order --save_safetensors vicunlocked-30b-4bit.safetensors
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- May 18, 2023
- Updated
- May 18, 2023