Downloads · 30 days
30
0% of all-time downloads
distilbert-base-uncased-agnews-student
joeddav/distilbert-base-uncased-agnews-student
distilbert-base-uncased-agnews-student is a text classification model from joeddav. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as mit.
This model is distilled from the zero-shot classification pipeline on the unlabeled AG's News dataset using this script. It is the result of the demo notebook here, where more details
All-time downloads
8.4K
Public
Repo size
804 MB
Likes
5
Public
Repo makeup
Click a slice to open those files.
.h5268 MB · 50%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- mit
- Model type
- distilbert
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Feb 18, 2021
- SHA
- 41503004
Try a prompt
Datasets
Model card
From the Hugging Face model README
distilbert-base-uncased-agnews-student
Model Description
This model is distilled from the zero-shot classification pipeline on the unlabeled AG's News dataset using this script. It is the result of the demo notebook here, where more details about the model can be found.
- Teacher model: roberta-large-mnli
- Teacher hypothesis template:
"This text is about {}."
Intended Usage
The model can be used like any other model trained on AG's News, but will likely not perform as well as a model trained with full supervision. It is primarily intended as a demo of how an expensive NLI-based zero-shot model can be distilled to a more efficient student.
- Task
- Text Classification
- Library
- transformers
- Type
- distilbert
- License
- mit
- Languages
- en
- Created
- Mar 2, 2022
- Updated
- Feb 18, 2021