Downloads · 30 days
82
1% of all-time downloads
hoa-1b4
vlsp-2023-vllm/hoa-1b4
hoa-1b4 is a text generation model from vlsp-2023-vllm. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as bigscience-bloom-rail-1.0.
Hoa is an autoregressive Large Language Model (LLM), based on Bloom's model architecture. Hoa was trained on part of the Common Crawl dataset in Vietnamese and English.
All-time downloads
8.3K
Public
Parameters
1.3B
16.2 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin5.2 GB · 50%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- bigscience-bloom-rail-1.0
- Model type
- bloom
- Access
- Public
- Created
- Jul 13, 2023
- Updated
- Oct 2, 2023
- SHA
- 66762dda
Datasets
Model card
From the Hugging Face model README
Hoa 1B4 (Bloom architecture)
Hoa is an autoregressive Large Language Model (LLM), based on Bloom's model architecture. Hoa was trained on part of the Common Crawl dataset in Vietnamese and English.
Details will be available soon.
To contact us, mail to: [email protected] (Lê Anh Cường) | [email protected] (Hiếu) | [email protected] (Nguyễn Việt Cường)
How to use
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("vlsp-2023-vllm/hoa-1b4")
model = AutoModelForCausalLM.from_pretrained("vlsp-2023-vllm/hoa-1b4", low_cpu_mem_usage=True)
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
model.to(device)
prompt = "Địa chỉ trường Đại học Tôn Đức Thắng nằm ở số"
input_ids = tokenizer(prompt, return_tensors="pt")['input_ids'].to(device)
gen_tokens = model.generate(input_ids, max_length=max_length, repetition_penalty=1.1)
print(tokenizer.batch_decode(gen_tokens)[0])
- Task
- Text Generation
- Library
- transformers
- Type
- bloom
- License
- bigscience-bloom-rail-1.0
- Languages
- vi, en
- Created
- Jul 13, 2023
- Updated
- Oct 2, 2023