Downloads · 30 days
11
1% of all-time downloads
sloberta-si-nli
cjvt/sloberta-si-nli
sloberta-si-nli is a text classification model from cjvt. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as cc-by-sa-4.0.
SloBERTa model finetuned on the SI-NLI dataset for Slovene natural language inference. Fine-tuned in a classic sequence pair classification setting on the official training/validation/test split for 10 epochs, using v…
All-time downloads
736
Public
Repo size
886 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin443 MB · 99%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- cc-by-sa-4.0
- Model type
- camembert
- Access
- Public
- Created
- Nov 11, 2022
- Updated
- Nov 11, 2022
- SHA
- d6f143fd
Model card
From the Hugging Face model README
sloberta-si-nli
SloBERTa model finetuned on the SI-NLI dataset for Slovene natural language inference.
Fine-tuned in a classic sequence pair classification setting on the official training/validation/test split for 10 epochs, using validation set accuracy for model selection.
Optimized using the AdamW optimizer (learning rate 2e-5) and cross-entropy loss.
Using batch size 82 (selected based on the available GPU memory) and maximum sequence length 102 (99th percentile of the lengths in the training set).
Achieves the following metrics:
- best validation accuracy:
0.720 - test accuracy =
0.735
- Task
- Text Classification
- Library
- transformers
- Type
- camembert
- License
- cc-by-sa-4.0
- Languages
- sl
- Created
- Nov 11, 2022
- Updated
- Nov 11, 2022