Downloads · 30 days
12
1% of all-time downloads
DistilBert-FakeNews
ahmednasser/DistilBert-FakeNews
DistilBert-FakeNews is a text classification model from ahmednasser. Use it when you need a label for a piece of text. It is set up for transformers.
Distilbert is created with knowledge distillation during the pre-training phase which reduces the size of a BERT model by 40%, while retaining 97% of its language understanding. It's smaller, faster than Bert and any…
All-time downloads
1.3K
Public
Repo size
531 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin266 MB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- Model type
- distilbert
- Access
- Public
- Created
- Apr 7, 2022
- Updated
- Apr 20, 2022
- SHA
- e3015860
Try a prompt
Model card
From the Hugging Face model README
Model description:
Distilbert is created with knowledge distillation during the pre-training phase which reduces the size of a BERT model by 40%, while retaining 97% of its language understanding. It's smaller, faster than Bert and any other Bert-based model.
Distilbert-base-uncased finetuned on the fake news dataset with below Hyperparameters
learning rate 5e-5,
batch size 32,
num_train_epochs=2,
Full code available @ DistilBert-FakeNews
Dataset available @ Fake News dataset
- Task
- Text Classification
- Library
- transformers
- Type
- distilbert
- Languages
- en
- Created
- Apr 7, 2022
- Updated
- Apr 20, 2022