Downloads · 30 days
103
20% of all-time downloads
KoichiYasuoka/modernbert-large-japanese-char
modernbert-large-japanese-char is a fill-mask model from KoichiYasuoka. Use it when you need the model to fill a missing word. The card lists the license as apache-2.0.
This is a ModernBERT model pre-trained on Japanese Wikipedia and 青空文庫 texts. NVIDIA A100-SXM4-40GB×8 took 116 hours 46 minutes for training. You can fine-tune modernbert-large-japanese-char for downstream tasks, such…
Downloads · 30 days
103
20% of all-time downloads
All-time downloads
526
Public
Repo size
4.4 GB
Likes
0
Public
Click a slice to open those files.
.bin1.5 GB · 100%
From the Hugging Face model README
This is a ModernBERT model pre-trained on Japanese Wikipedia and 青空文庫 texts. NVIDIA A100-SXM4-40GB×8 took 116 hours 46 minutes for training. You can fine-tune modernbert-large-japanese-char for downstream tasks, such as POS-tagging, dependency-parsing, and so on.
from transformers import AutoTokenizer,AutoModelForMaskedLM
tokenizer=AutoTokenizer.from_pretrained("KoichiYasuoka/modernbert-large-japanese-char")
model=AutoModelForMaskedLM.from_pretrained("KoichiYasuoka/modernbert-large-japanese-char",trust_remote_code=True)