Downloads · 30 days
5
9% of all-time downloads
distilbert_finetuned_newsgroups
indikamk/distilbert_finetuned_newsgroups
distilbert_finetuned_newsgroups is a text classification model from indikamk. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tuned version of distilbert-base-uncased on 20 Newsgroups dataset.
All-time downloads
55
Public
Repo size
268 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.h5268 MB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- apache-2.0
- Model type
- distilbert
- Access
- Public
- Created
- May 19, 2023
- Updated
- May 19, 2023
- SHA
- 0b409f67
Try a prompt
Model card
From the Hugging Face model README
distilbert_finetuned_newsgroups
This model is a fine-tuned version of distilbert-base-uncased on 20 Newsgroups dataset.
Training procedure
Used 10% of the training set as the validation set.
Training hyperparameters
The following hyperparameters were used during training:
- optimizer: {'name': 'Adam', 'weight_decay': None, 'clipnorm': None, 'global_clipnorm': None, 'clipvalue': None, 'use_ema': False, 'ema_momentum': 0.99, 'ema_overwrite_frequency': None, 'jit_compile': True, 'is_legacy_optimizer': False, 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 1908, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
- training_precision: float32
Training results
Achieves 83.13% accuracy on Test set.
Framework versions
- Transformers 4.28.0
- TensorFlow 2.12.0
- Datasets 2.12.0
- Tokenizers 0.13.3
- Task
- Text Classification
- Library
- transformers
- Type
- distilbert
- License
- apache-2.0
- Created
- May 19, 2023
- Updated
- May 19, 2023