Downloads · 30 days
34
5% of all-time downloads
scibert-wechsel-korean
LeverageX/scibert-wechsel-korean
scibert-wechsel-korean is a fill-mask model from LeverageX. Use it when you need the model to fill a missing word. It is set up for transformers.
Scibert(🇺🇸) converted into Korean(🇰🇷) using WECHSEL technique.
All-time downloads
702
Public
Repo size
1.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin885 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Jan 8, 2022
- SHA
- 7b949b91
Try a prompt
Model card
From the Hugging Face model README
scibert-wechsel-korean
Scibert(🇺🇸) converted into Korean(🇰🇷) using WECHSEL technique.
Description
- SciBERT is trained on papers from the corpus of semanticscholar.org. Corpus size is 1.14M papers, 3.1B tokens.
- Wechsel is converting embedding layer's subword tokens from source language to target language.
- SciBERT trained with English language is converted into Korean langauge using Wechsel technique.
- Korean tokenizer is selected with KLUE PLMs' tokenizers due to its similar vocab size(32000) and performance.
Reference
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- Created
- Mar 2, 2022
- Updated
- Jan 8, 2022