Downloads · 30 days
31
1% of all-time downloads
Langboat/bloom-800m-zh
bloom-800m-zh is a text generation model from Langboat. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as bigscience-bloom-rail-1.0.
This model is based on bigscience/bloom-1b1.
Downloads · 30 days
31
1% of all-time downloads
All-time downloads
2.1K
Public
Repo size
6.6 GB
Likes
3
Public
Click a slice to open those files.
.bin3.3 GB · 100%
From the Hugging Face model README
This model is based on bigscience/bloom-1b1.
We pruned its vocabulary from 250880 to 46145 with Chinese corpus to reduce GPU memory usage. So the total parameter is 800m now.
from transformers import BloomTokenizerFast, BloomForCausalLM
tokenizer = BloomTokenizerFast.from_pretrained('Langboat/bloom-800m-zh')
model = BloomForCausalLM.from_pretrained('Langboat/bloom-800m-zh')
print(tokenizer.batch_decode(model.generate(tokenizer.encode('中国的首都是', return_tensors='pt'))))