Downloads · 30 days
4
6% of all-time downloads
multilingual-ili-detection-bernice
nitimkc/multilingual-ili-detection-bernice
multilingual-ili-detection-bernice is a text classification model from nitimkc. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tuned version of jhu-clsp/bernice for Influenza-Like-Illness(ILI) detection in multilingual tweets.
All-time downloads
62
Public
Parameters
278M
1.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.1 GB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- apache-2.0
- Model type
- xlm-roberta
- Access
- Public
- Created
- Jul 30, 2024
- Updated
- Jul 30, 2024
- SHA
- ed9809b3
Try a prompt
Datasets
Model card
From the Hugging Face model README
multilingual-ili-detection-bernice
This model is a fine-tuned version of jhu-clsp/bernice for Influenza-Like-Illness(ILI) detection in multilingual tweets.
Please reach out to Niti Mishra K.C. (nitimkc at gmail.com) or open an issue if there are questions.
Model description
The model can be loaded with the following lines of code:
from transformers import AutoModelForSequenceClassification
ili_classification_model = AutoModelForSequenceClassification.from_pretrained('nitimkc/multilingual-ili-detection-bernice', num_labels = 2)
Training hyperparameters
The following hyperparametesr were used during training:
- learning_rate: 0.0000227436540339458
- train_batch_size: 32
- eval_batch_size: 32
- seed: 712
- num_epochs: 3
- max_len: 64
Training results
| Training Loss | Epoch | Validation Loss | Validation f1 |
|---|---|---|---|
| 0.4067 | 1.0 | 0.3081 | 0.8658 |
| 0.2686 | 2.0 | 0.3037 | 0.8821 |
| 0.1881 | 3.0 | 0.3140 | 0.8800 |
Framework versions
- Transformers 4.35.2
- Pytorch 2.1.2
- scikit-learn 1.3.2
- sentencepiece 0.1.99
- Tokenizers 0.15.2
- wandb 0.16.3
- Task
- Text Classification
- Library
- transformers
- Type
- xlm-roberta
- License
- apache-2.0
- Languages
- en, fr, es, it, de
- Created
- Jul 30, 2024
- Updated
- Jul 30, 2024