Downloads · 30 days
278
2% of all-time downloads
electra-small-japanese-discriminator
cinmodel/electra-small-japanese-discriminator
electra-small-japanese-discriminator is a machine learning model from cinmodel. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
We provide a Japanese ELECTRA-Small model, as described in ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators.
All-time downloads
15.4K
Public
Repo size
110 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin55 MB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- electra
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Dec 11, 2020
- SHA
- 556f3373
Model card
From the Hugging Face model README
Japanese ELECTRA-small
We provide a Japanese ELECTRA-Small model, as described in ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators.
Our pretraining process employs subword units derived from the Japanese Wikipedia, using the Byte-Pair Encoding method and building on an initial tokenization with mecab-ipadic-NEologd. For optimal performance, please take care to set your MeCab dictionary appropriately.
How to use the discriminator in transformers
from transformers import BertJapaneseTokenizer, ElectraForPreTraining
tokenizer = BertJapaneseTokenizer.from_pretrained('Cinnamon/electra-small-japanese-discriminator', mecab_kwargs={"mecab_option": "-d /usr/lib/x86_64-linux-gnu/mecab/dic/mecab-ipadic-neologd"})
model = ElectraForPreTraining.from_pretrained('Cinnamon/electra-small-japanese-discriminator')
- Library
- transformers
- Type
- electra
- License
- apache-2.0
- Languages
- ja
- Created
- Mar 2, 2022
- Updated
- Dec 11, 2020