Downloads · 30 days
7
13% of all-time downloads
Langboat_-_bloom-1b4-zh-8bits
RichardErkhov/Langboat_-_bloom-1b4-zh-8bits
Langboat_-_bloom-1b4-zh-8bits is a text generation model from RichardErkhov. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
55
Public
Parameters
1.3B
1.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.4 GB · 100%
Parameter types
How the weights are stored.
I81.2B · 93%
Try a prompt
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
bloom-1b4-zh - bnb 8bits
- Model creator: https://huggingface.co/Langboat/
- Original model: https://huggingface.co/Langboat/bloom-1b4-zh/
Original model description:
license: bigscience-bloom-rail-1.0 language:
- zh pipeline_tag: text-generation widget:
- text: "中国的首都是"
This model is based on bigscience/bloom-1b7.
We pruned its vocabulary from 250880 to 46145 with Chinese corpus to reduce GPU memory usage. So the total parameter is 1.4b now.
How to use
from transformers import BloomTokenizerFast, BloomForCausalLM
tokenizer = BloomTokenizerFast.from_pretrained('Langboat/bloom-1b4-zh')
model = BloomForCausalLM.from_pretrained('Langboat/bloom-1b4-zh')
print(tokenizer.batch_decode(model.generate(tokenizer.encode('中国的首都是', return_tensors='pt'))))
- Task
- Text Generation
- Library
- transformers
- Type
- bloom
- Created
- Jul 20, 2024
- Updated
- Jul 20, 2024