Downloads · 30 days
124
4% of all-time downloads
Langboat/bloom-6b4-zh
bloom-6b4-zh is a text generation model from Langboat. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as bigscience-bloom-rail-1.0.
This model is based on bigscience/bloom-7b1.
Downloads · 30 days
124
4% of all-time downloads
All-time downloads
2.9K
Public
Repo size
51.4 GB
Likes
11
Public
Click a slice to open those files.
.bin25.7 GB · 100%
From the Hugging Face model README
This model is based on bigscience/bloom-7b1.
We pruned its vocabulary from 250880 to 46145 with Chinese corpus to reduce GPU memory usage. So the total parameter is 6b4 now.
from transformers import BloomTokenizerFast, BloomForCausalLM
tokenizer = BloomTokenizerFast.from_pretrained('Langboat/bloom-6b4-zh')
model = BloomForCausalLM.from_pretrained('Langboat/bloom-6b4-zh')
print(tokenizer.batch_decode(model.generate(tokenizer.encode('中国的首都是', return_tensors='pt'))))