Downloads · 30 days
69
7% of all-time downloads
megagonlabs/transformers-ud-japanese-electra-base-ginza-520
transformers-ud-japanese-electra-base-ginza-520 is a feature extraction model from megagonlabs. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
This is an ELECTRA model pretrained on approximately 200M Japanese sentences extracted from the mC4 and finetuned by spaCy v3 on UD\Japanese\BCCWJ r2.8.
Downloads · 30 days
69
7% of all-time downloads
All-time downloads
949
Public
Repo size
869 MB
Likes
2
Public
Click a slice to open those files.
.bin434 MB · 100%
From the Hugging Face model README
This is an ELECTRA model pretrained on approximately 200M Japanese sentences extracted from the mC4 and finetuned by spaCy v3 on UD_Japanese_BCCWJ r2.8.
The base pretrain model is megagonlabs/transformers-ud-japanese-electra-base-discrimininator.
The entire spaCy v3 model is distributed as a python package named ja_ginza_electra from PyPI along with GiNZA v5 which provides some custom pipeline components to recognize the Japanese bunsetu-phrase structures.
Try running it as below:
$ pip install ginza ja_ginza_electra
$ ginza
The models are distributed under the terms of the MIT License.
This model is permitted to be published under the MIT License under a joint research agreement between NINJAL (National Institute for Japanese Language and Linguistics) and Megagon Labs Tokyo.
Contains information from mC4 which is made available under the ODC Attribution License.
@article{2019t5,
author = {Colin Raffel and Noam Shazeer and Adam Roberts and Katherine Lee and Sharan Narang and Michael Matena and Yanqi Zhou and Wei Li and Peter J. Liu},
title = {Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer},
journal = {arXiv e-prints},
year = {2019},
archivePrefix = {arXiv},
eprint = {1910.10683},
}
Asahara, M., Kanayama, H., Tanaka, T., Miyao, Y., Uematsu, S., Mori, S.,
Matsumoto, Y., Omura, M., & Murawaki, Y. (2018).
Universal Dependencies Version 2 for Japanese.
In LREC-2018.