Downloads · 30 days
0
distill-bert-txt-classification
milapp857/distill-bert-txt-classification
distill-bert-txt-classification is a machine learning model from milapp857. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This contains the state dict of a distilled BERT model.
Access
Public
Updated May 13, 2025
Repo size
460 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt460 MB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- May 13, 2025
- Updated
- May 13, 2025
- SHA
- fcf6d99c
Model card
From the Hugging Face model README
This contains the state dict of a distilled BERT model.
The teacher BERT model was fine-tuned on the BBC's Text classification dataset: https://huggingface.co/milapp857/bert-finetuned-txt-classification
The distillation method used is response-based knoweldge distillation.
Note that the student model itself isn't pre-trained in this initial version, since my intention was learning knwoledge distillation only.
The model class for this picke file and training code can be found here: https://github.com/lavanderhoney/bert-distillation-quantization/blob/main/distillation.py
- License
- mit
- Created
- May 13, 2025
- Updated
- May 13, 2025