Downloads · 30 days
31
2% of all-time downloads
Langboat/bloom-2b5-zh
bloom-2b5-zh is a text generation model from Langboat. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as bigscience-bloom-rail-1.0.
This model is based on bigscience/bloom-3b.
Downloads · 30 days
31
2% of all-time downloads
All-time downloads
1.8K
Public
Repo size
20.8 GB
Likes
1
Public
Click a slice to open those files.
.bin10.4 GB · 100%
From the Hugging Face model README
This model is based on bigscience/bloom-3b.
We pruned its vocabulary from 250880 to 46145 with Chinese corpus to reduce GPU memory usage. So the total parameter is 2b5 now.
from transformers import BloomTokenizerFast, BloomForCausalLM
tokenizer = BloomTokenizerFast.from_pretrained('Langboat/bloom-2b5-zh')
model = BloomForCausalLM.from_pretrained('Langboat/bloom-2b5-zh')
print(tokenizer.batch_decode(model.generate(tokenizer.encode('中国的首都是', return_tensors='pt'))))