Downloads · 30 days
16
3% of all-time downloads
TinyMistral-248M-v2-cleaner
M4-ai/TinyMistral-248M-v2-cleaner
TinyMistral-248M-v2-cleaner is a text classification model from M4-ai. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.
This model is used to deep clean the Rhino dataset, making it a higher quality dataset. This model achieved an average MSE loss of 0.095 during training. We recommend to use the sigmoid function to turn the logits int…
All-time downloads
467
Public
Repo size
862 MB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.bin431 MB · 99%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Jan 8, 2024
- Updated
- Jan 8, 2024
- SHA
- 127323e8
Try a prompt
Datasets
Model card
From the Hugging Face model README
Use cases
This model is used to deep clean the Rhino dataset, making it a higher quality dataset. This model achieved an average MSE loss of 0.095 during training. We recommend to use the sigmoid function to turn the logits into probabilities:
1 / (1 + torch.exp(logits))
Training
Using trl's RewardTrainer, this model was trained on berkeley-nest/Nectar. The dataset is curated on-the-fly during training, as explained in the Rhino repo.
- Task
- Text Classification
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Languages
- en
- Created
- Jan 8, 2024
- Updated
- Jan 8, 2024