Downloads · 30 days
26
2% of all-time downloads
bloom-396m-zh
YeungNLP/bloom-396m-zh
bloom-396m-zh is a text generation model from YeungNLP. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
1.7K
Public
Repo size
1.4 GB
Likes
5
Public
Repo makeup
Click a slice to open those files.
.bin699 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- bloom
- Access
- Public
- Created
- Mar 27, 2023
- Updated
- Apr 3, 2023
- SHA
- 6fd190b6
Try a prompt
Model card
From the Hugging Face model README
项目地址：LLMPruner：大语言模型裁剪工具
LLMPruner是一个大语言模型裁剪工具，通过对大语言模型的冗余词表进行裁剪，减少模型参数量，降低显存占用，提升训练速度，并且能够保留预训练中学习到的知识。
本项目对Bloom进行词表裁剪，保留中文token和常用的英文token，词表由250880将至46145，缩减为原来的18.39%。裁剪得到的Bloom模型如下表：
使用方法：
from transformers import BloomTokenizerFast, BloomForCausalLM
tokenizer = BloomTokenizerFast.from_pretrained('YeungNLP/bloom-1b4-zh')
model = BloomForCausalLM.from_pretrained('YeungNLP/bloom-1b4-zh')
print(tokenizer.batch_decode(model.generate(tokenizer.encode('长风破浪会有时', return_tensors='pt'))))
- Task
- Text Generation
- Library
- transformers
- Type
- bloom
- Created
- Mar 27, 2023
- Updated
- Apr 3, 2023