Downloads · 30 days
152
45% of all-time downloads
bert-tiny-japanese-char
bluolightning/bert-tiny-japanese-char
bert-tiny-japanese-char is a fill-mask model from bluolightning. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
This model is a tiny Japanese BERT model with 4 layers, optimized for speed.
All-time downloads
336
Public
Parameters
4.8M
19.4 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors19.4 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- apache-2.0
- Model type
- bert
- Access
- Public
- Created
- Feb 8, 2026
- Updated
- Feb 8, 2026
- SHA
- c7fab375
Model card
From the Hugging Face model README
Custom Japanese BERT (4-layer)
This model is a tiny Japanese BERT model with 4 layers, optimized for speed.
Model Background
- Architecture: BERT (4 layers, 256 hidden size, 4 heads, 1024 FFN)
- Distillation: Distilled from a fine-tuned version of
tohoku-nlp/bert-base-japanese-char-v2. - Initialization: The student model was randomly initialized.
- Tokenizer: Japanese Character-level tokenizer, shared with the teacher.
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- apache-2.0
- Languages
- ja
- Created
- Feb 8, 2026
- Updated
- Feb 8, 2026