Downloads · 30 days
7
18% of all-time downloads
Romi121/particle_prediction_model
particle_prediction_model is a text classification model from Romi121. Use it when you need a label for a piece of text. The card lists the license as cc-by-sa-3.0.
BERT based Token Classification model based on tohoku-nlp/bert-base-japanse and trained to predict a Japanese sentence with subject MASKed which particle (は,が,も) would most likely follow the MASK.
Downloads · 30 days
7
18% of all-time downloads
All-time downloads
39
Public
Parameters
111M
443 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors443 MB · 100%
From the Hugging Face model README
BERT based Token Classification model based on tohoku-nlp/bert-base-japanse and trained to predict a Japanese sentence with subject MASKed which particle (は,が,も) would most likely follow the MASK.
This model was trained as part of a bigger project to predict implicit subjects in Japanese text. You can find whole project here [https://github.com/Romi212/Japanese-Subject-Predictor-System]
Model was trained using dataset https://github.com/UniversalDependencies/UD_Japanese-GSDLUW
The dataset was reduced only to sentences with a subject, and the subject subclause was replaced by [MASK] saving the particle asociated as the label to predict.