Downloads · 30 days
0
fine-tuned-PL_BERT-hindi
Ionio-ai/fine-tuned-PL_BERT-hindi
fine-tuned-PL_BERT-hindi is a machine learning model from Ionio-ai. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model is a fine-tuned version of PL-BERT, specifically trained on the Hindi subset of the Wiki40b dataset. The model has been optimized to understand and generate high-quality Hindi text, making it suitable for v…
Access
Public
Updated Nov 4, 2024
Repo size
175 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.t7175 MB · 100%
At a glance
- Access
- Public
- Created
- Nov 4, 2024
- Updated
- Nov 4, 2024
- SHA
- 95ef72e6
Model card
From the Hugging Face model README
PL-BERT Fine-Tuned on Hindi Wikipedia Dataset
This model is a fine-tuned version of PL-BERT, specifically trained on the Hindi subset of the Wiki40b dataset. The model has been optimized to understand and generate high-quality Hindi text, making it suitable for various NLP tasks in the Hindi language. For more information about this model, check out the GitHub repository.
Model Overview
- Model Name: PL-BERT (Fine-tuned on Hindi)
- Base Model: PL-BERT (Multilingual BERT variant)
- Dataset: Hindi subset from Wiki40b (51,000 cleaned Wikipedia articles)
- Precision: Mixed precision (FP16)
The fine-tuning process focused on improving the model's ability to handle Hindi text more effectively by leveraging a large, cleaned corpus of Wikipedia articles in Hindi.
Training Details
- Model: PL-BERT
- Dataset: Hindi subset from Wiki40b
- Batch Size: 64
- Mixed Precision: FP16
- Optimizer: AdamW
- Training Steps: 15,000
Training Progress
- Final Loss: 1.879
- Vocabulary Loss: 0.49
- Token Loss: 1.465
Validation Results
During training, we monitored performance with validation metrics:
- Validation Loss: 1.879
- Vocabulary Accuracy: 78.54%
- Token Accuracy: 82.30%
license: apache-2.0
- Created
- Nov 4, 2024
- Updated
- Nov 4, 2024