Downloads · 30 days
0
0% of all-time downloads
bloomz-3b-4bit-quant
Veer15/bloomz-3b-4bit-quant
bloomz-3b-4bit-quant is a text generation model from Veer15. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as cc.
Quantized bloomz-3b using peft(lora) <br 4 bit quant is used <br GPU will be needed to use this model
All-time downloads
2
Public
Repo size
2.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin2.5 GB · 99%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- cc
- Model type
- bloom
- Access
- Public
- Created
- Sep 21, 2023
- Updated
- Sep 27, 2023
- SHA
- 67a18432
Try a prompt
Model card
From the Hugging Face model README
Quantized bloomz-3b using peft(lora) <br> 4 bit quant is used <br> GPU will be needed to use this model
- Task
- Text Generation
- Library
- peft
- Type
- bloom
- License
- cc
- Languages
- en
- Created
- Sep 21, 2023
- Updated
- Sep 27, 2023