Downloads · 30 days
8
1% of all-time downloads
krelectra-base-mecab
Jinhwan/krelectra-base-mecab
krelectra-base-mecab is a machine learning model from Jinhwan. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Korean-based Pre-trained ELECTRA Language Model using Mecab (Morphological Analyzer)
All-time downloads
1.1K
Public
Repo size
885 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin443 MB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- electra
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Jan 12, 2022
- SHA
- 443b6410
Model card
From the Hugging Face model README
KrELECTRA-base-mecab
Korean-based Pre-trained ELECTRA Language Model using Mecab (Morphological Analyzer)
Usage
Load model and tokenizer
>>> from transformers import AutoTokenizer, AutoModelForPreTraining
>>> model = AutoModelForPreTraining.from_pretrained("Jinhwan/krelectra-base-mecab")
>>> tokenizer = AutoTokenizer.from_pretrained("Jinhwan/krelectra-base-mecab")
Tokenizer example
>>> from transformers import AutoTokenizer
>>> tokenizer = AutoTokenizer.from_pretrained("Jinhwan/krelectra-base-mecab")
>>> tokenizer.tokenize("[CLS] 한국어 ELECTRA를 공유합니다. [SEP]")
['[CLS]', '한국어', 'EL', '##ECT', '##RA', '##를', '공유', '##합', '##니다', '.', '[SEP]']
>>> tokenizer.convert_tokens_to_ids(['[CLS]', '한국어', 'EL', '##ECT', '##RA', '##를', '공유', '##합', '##니다', '.', '[SEP]'])
[2, 7214, 24023, 24663, 26580, 3195, 7086, 3746, 5500, 17, 3]
- Library
- transformers
- Type
- electra
- License
- apache-2.0
- Languages
- ko
- Created
- Mar 2, 2022
- Updated
- Jan 12, 2022