Downloads · 30 days
7
12% of all-time downloads
bertje_dutch-cola
HylkeBr/bertje_dutch-cola
bertje_dutch-cola is a text classification model from HylkeBr. Use it when you need a label for a piece of text. It is set up for transformers.
This model is a fine-tuned version of GroNLP/bert-base-dutch-cased on GroNLP/dutch-cola, from where only the acceptable and unacceptable examples were used to fine-tune. The data used for fine-tuning therefore only co…
All-time downloads
58
Public
Parameters
109M
437 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors437 MB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- May 29, 2024
- Updated
- Jun 3, 2024
- SHA
- d3778684
Datasets
Model card
From the Hugging Face model README
This model is a fine-tuned version of GroNLP/bert-base-dutch-cased on GroNLP/dutch-cola, from where only the acceptable and unacceptable examples were used to fine-tune. The data used for fine-tuning therefore only contains sentences with original mark 'None' and '*'.
Accuracy: 0.8127
The following hyperparameters were used during training:
learning rate: 4e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
num_epochs: 4
| Epoch | Training Loss | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| 1.0 | 0.4971 | 1169 | 0.4629 | 0.7914 |
| 2.0 | 0.2478 | 2338 | 0.7041 | 0.7814 |
| 3.0 | 0.1333 | 3507 | 0.9777 | 0.8064 |
| 4.0 | 0.0687 | 4676 | 1.1322 | 0.8127 |
- Task
- Text Classification
- Library
- transformers
- Type
- bert
- Languages
- nl
- Created
- May 29, 2024
- Updated
- Jun 3, 2024