Downloads · 30 days
7
14% of all-time downloads
kaisar-barlybay-sse/kaz_legal_distilbert_full_corpus_3.0
kaz_legal_distilbert_full_corpus_3.0 is a fill-mask model from kaisar-barlybay-sse. Use it when you need the model to fill a missing word. It is set up for transformers.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
7
14% of all-time downloads
All-time downloads
49
Public
Repo size
536 MB
Likes
0
Public
Click a slice to open those files.
.bin268 MB · 99%
From the Hugging Face model README
This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 6.6228 | 0.32 | 1000 | 6.4585 |
| 6.2811 | 0.64 | 2000 | 6.2602 |
| 6.1313 | 0.96 | 3000 | 6.1338 |
| 5.9671 | 1.28 | 4000 | 5.9722 |
| 5.8529 | 1.6 | 5000 | 5.8634 |
| 5.7655 | 1.92 | 6000 | 5.7714 |
| 5.6925 | 2.24 | 7000 | 5.6978 |
| 5.6311 | 2.56 | 8000 | 5.6411 |
| 5.5994 | 2.88 | 9000 | 5.6108 |