Downloads · 30 days
7
21% of all-time downloads
distilbert-base-uncased-finetuned-imdb-HF-tutorial-using-accelerate
thuann2cats/distilbert-base-uncased-finetuned-imdb-HF-tutorial-using-accelerate
distilbert-base-uncased-finetuned-imdb-HF-tutorial-using-accelerate is a fill-mask model from thuann2cats. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tuned version of distilbert-base-uncased on a small subset of the imdb dataset. This is an experiment that follows the HuggingFace NLP tutorial on masked language modeling and domain adaptation.
All-time downloads
34
Public
Parameters
67M
804 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors268 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- apache-2.0
- Model type
- distilbert
- Access
- Public
- Created
- Jun 30, 2024
- Updated
- Jun 30, 2024
- SHA
- 0731e8b9
Try a prompt
Base models
Model card
From the Hugging Face model README
distilbert-base-uncased-finetuned-imdb-HF-tutorial-using-trainer
This model is a fine-tuned version of distilbert-base-uncased on a small subset of the imdb dataset. This is an experiment that follows the HuggingFace NLP tutorial on masked language modeling and domain adaptation.
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 64
- eval_batch_size: 64
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 3.0
- mixed_precision_training: Native AMP
Framework versions
- Transformers 4.41.2
- Pytorch 2.3.1+cu121
- Datasets 2.20.0
- Tokenizers 0.19.1
- Task
- Fill-Mask
- Library
- transformers
- Type
- distilbert
- License
- apache-2.0
- Created
- Jun 30, 2024
- Updated
- Jun 30, 2024