Downloads · 30 days
11
19% of all-time downloads
Langboat_-_bloom-1b4-zh-4bits
RichardErkhov/Langboat_-_bloom-1b4-zh-4bits
Langboat_-_bloom-1b4-zh-4bits is a text generation model from RichardErkhov. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
58
Public
Parameters
1.3B
870 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors870 MB · 100%
Parameter types
How the weights are stored.
U81.2B · 91%
Try a prompt
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
bloom-1b4-zh - bnb 4bits
- Model creator: https://huggingface.co/Langboat/
- Original model: https://huggingface.co/Langboat/bloom-1b4-zh/
Original model description:
license: bigscience-bloom-rail-1.0 language:
- zh pipeline_tag: text-generation widget:
- text: "中国的首都是"
This model is based on bigscience/bloom-1b7.
We pruned its vocabulary from 250880 to 46145 with Chinese corpus to reduce GPU memory usage. So the total parameter is 1.4b now.
How to use
from transformers import BloomTokenizerFast, BloomForCausalLM
tokenizer = BloomTokenizerFast.from_pretrained('Langboat/bloom-1b4-zh')
model = BloomForCausalLM.from_pretrained('Langboat/bloom-1b4-zh')
print(tokenizer.batch_decode(model.generate(tokenizer.encode('中国的首都是', return_tensors='pt'))))
- Task
- Text Generation
- Library
- transformers
- Type
- bloom
- Created
- Jul 20, 2024
- Updated
- Jul 20, 2024