Downloads · 30 days
66
3% of all-time downloads
bad-korean-tokenizer
emeraldgoose/bad-korean-tokenizer
bad-korean-tokenizer is a machine learning model from emeraldgoose. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
KcELECTRA(https://github.com/Beomi/KcELECTRA)의 Tokenizer에서 [UNK]로 대체되는 토큰들을 추가했습니다.
All-time downloads
1.9K
Public
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json1.5 MB · 79%
At a glance
- Library
- transformers
- Model type
- electra
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Dec 8, 2021
- SHA
- 076a1286
Model card
From the Hugging Face model README
KcELECTRA(https://github.com/Beomi/KcELECTRA)의 Tokenizer에서 [UNK]로 대체되는 토큰들을 추가했습니다.
- Library
- transformers
- Type
- electra
- Created
- Mar 2, 2022
- Updated
- Dec 8, 2021