Downloads · 30 days
13
1% of all-time downloads
t5-v1_1-base-ko
team-lucid/t5-v1_1-base-ko
t5-v1_1-base-ko is a machine learning model from team-lucid. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Google's T5 Version 1.1 that trained on korean corpus
All-time downloads
1.1K
Public
Parameters
248M
5.1 GB on disk
Likes
5
Public
Repo makeup
Click a slice to open those files.
.ot1.2 GB · 23%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- t5
- Access
- Public
- Created
- Dec 5, 2022
- Updated
- Oct 16, 2023
- SHA
- 913c025e
Model card
From the Hugging Face model README
team-lucid/t5-v1_1-base-ko
Google's T5 Version 1.1 that trained on korean corpus
t5-v1_1-base-ko은 한국어 코퍼스에서 학습된 t5 v1.1 모델입니다.
OOV을 막기 위해 BBPE를 사용하였으며, HyperCLOVA에서 형태소 분석이 성능을 높히는데 도움이 되는 것을 보고 토크나이저 학습 과정에서 MeCab을 이용해 형태소가 이상하게 토큰화되지 않도록 하였습니다.
이 연구는 구글의 TPU Research Cloud(TRC)를 통해 지원받은 Cloud TPU로 학습되었습니다.
Usage
from transformers import AutoTokenizer, T5ForConditionalGeneration
tokenizer = AutoTokenizer.from_pretrained('team-lucid/t5-v1_1-base-ko')
model = T5ForConditionalGeneration.from_pretrained('team-lucid/t5-v1_1-base-ko')
- Library
- transformers
- Type
- t5
- License
- apache-2.0
- Languages
- ko
- Created
- Dec 5, 2022
- Updated
- Oct 16, 2023