Downloads · 30 days
6
0% of all-time downloads
bloomz-7b1-gguf
hzjane/bloomz-7b1-gguf
bloomz-7b1-gguf is a machine learning model from hzjane. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Upload bloomz-7b1-q40.gguf, converted from bloomz-7b1 by llama.cpp's bash convert-hf-to-gguf.py.
All-time downloads
1.9K
Public
Repo size
4.8 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf4.8 GB · 100%
At a glance
- Access
- Public
- Created
- Dec 20, 2023
- Updated
- Dec 20, 2023
- SHA
- 65abf122
Model card
From the Hugging Face model README
Upload bloomz-7b1-q4_0.gguf, converted from bloomz-7b1 by llama.cpp's bash convert-hf-to-gguf.py.
python convert-hf-to-gguf.py --outfile bloomz-7b1.gguf --outtype f16 /mnt/disk1/models/bloomz-7b1/
./build/bin/quantize bloomz-7b1.gguf bloomz-7b1-q4_0.gguf q4_0
- Created
- Dec 20, 2023
- Updated
- Dec 20, 2023