Downloads · 30 days
23
5% of all-time downloads
JeBERT_ko_je
kompactss/JeBERT_ko_je
JeBERT_ko_je is a machine learning model from kompactss. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as afl-3.0.
- 표준어 - 제주어 - Made by. 구름 자연어처리 과정 3기 3조!! - github link : https://github.com/Goormnlpteam3/JeBERT
All-time downloads
459
Public
Repo size
2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin990 MB · 100%
At a glance
- Library
- transformers
- License
- afl-3.0
- Model type
- encoder-decoder
- Access
- Public
- Created
- May 1, 2022
- Updated
- May 16, 2022
- SHA
- 5e46846e
Model card
From the Hugging Face model README
🍊 제주 방언 번역 모델 🍊
- 표준어 -> 제주어
- Made by. 구름 자연어처리 과정 3기 3조!!
- github link : https://github.com/Goormnlpteam3/JeBERT
1. Seq2Seq Transformer Model
- encoder : BertConfig
- decoder : BertConfig
- Tokenizer : WordPiece Tokenizer
2. Dataset
- Jit Dataset
- AI HUB(+아래아 문자)
3. Hyper Parameters
- Epoch : 10 epochs(best at 7 epoch)
- Random Seed : 42
- Learning Rate : 5e-5
- Warm up Ratio : 0.1
- Batch Size : 32
4. BLEU Score
- Jit + AI HUB(+아래아 문자) Dataset : 67.3
CREDIT
- 주형준 : [email protected]
- 강가람 : [email protected]
- 고광연 : [email protected]
- 김수연 : [email protected]
- 이원경 : [email protected]
- 조성은 : [email protected]
- Library
- transformers
- Type
- encoder-decoder
- License
- afl-3.0
- Created
- May 1, 2022
- Updated
- May 16, 2022