Downloads · 30 days
1.7K
1% of all-time downloads
Langboat/bloom-1b4-zh
bloom-1b4-zh is a text generation model from Langboat. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as bigscience-bloom-rail-1.0.
This model is based on bigscience/bloom-1b7.
Downloads · 30 days
1.7K
1% of all-time downloads
All-time downloads
148K
Public
Parameters
1.4B
11.2 GB on disk
Likes
19
Public
Click a slice to open those files.
.bin5.6 GB · 50%
From the Hugging Face model README
This model is based on bigscience/bloom-1b7.
We pruned its vocabulary from 250880 to 46145 with Chinese corpus to reduce GPU memory usage. So the total parameter is 1.4b now.
from transformers import BloomTokenizerFast, BloomForCausalLM
tokenizer = BloomTokenizerFast.from_pretrained('Langboat/bloom-1b4-zh')
model = BloomForCausalLM.from_pretrained('Langboat/bloom-1b4-zh')
print(tokenizer.batch_decode(model.generate(tokenizer.encode('中国的首都是', return_tensors='pt'))))