Downloads · 30 days
9
1% of all-time downloads
crosloengual-bert-si-nli
cjvt/crosloengual-bert-si-nli
crosloengual-bert-si-nli is a text classification model from cjvt. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as cc-by-4.0.
CroSloEngual BERT model finetuned on the SI-NLI dataset for Slovene natural language inference. Fine-tuned in a classic sequence pair classification setting on the official training/validation/test split for 10 epochs…
All-time downloads
621
Public
Repo size
993 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin497 MB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- cc-by-4.0
- Model type
- bert
- Access
- Public
- Created
- Nov 11, 2022
- Updated
- Jan 8, 2023
- SHA
- d9fedb52
Model card
From the Hugging Face model README
crosloengual-bert-si-nli
CroSloEngual BERT model finetuned on the SI-NLI dataset for Slovene natural language inference.
Fine-tuned in a classic sequence pair classification setting on the official training/validation/test split for 10 epochs, using validation set accuracy for model selection.
Optimized using the AdamW optimizer (learning rate 2e-5) and cross-entropy loss.
Using batch size 82 (selected based on the available GPU memory) and maximum sequence length 107 (99th percentile of the lengths in the training set).
Achieves the following metrics:
- best validation accuracy:
0.660 - test accuracy =
0.673
- Task
- Text Classification
- Library
- transformers
- Type
- bert
- License
- cc-by-4.0
- Languages
- sl, hr, en, multilingual
- Created
- Nov 11, 2022
- Updated
- Jan 8, 2023