Downloads · 30 days
15
2% of all-time downloads
sst2-distilbert-sparse-blog
RedHatAI/sst2-distilbert-sparse-blog
sst2-distilbert-sparse-blog is a text classification model from RedHatAI. Use it when you need a label for a piece of text. It is set up for transformers.
Repo includes all necessary files for staging an Inference Endpoints API with DeepSparse as discussed in this BLOG. This DistilBERT was sparsified using the SparseML library.
All-time downloads
603
Public
Repo size
67.2 MB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.onnx67.2 MB · 99%
At a glance
- Task
- Text Classification
- Library
- transformers
- Model type
- distilbert
- Access
- Public
- Created
- Dec 19, 2022
- Updated
- Mar 13, 2024
- SHA
- 89f3303a
Try a prompt
Datasets
Model card
From the Hugging Face model README
Repo includes all necessary files for staging an Inference Endpoints API with DeepSparse as discussed in this BLOG. This DistilBERT was sparsified using the SparseML library.
Sparse Transfer 80% VNNI Pruned DistilBERT
This model is the result of pruning the DistilBERT model to 80% using the VNNI blocking (semi-structured), followed by fine-tuning and quantization on the SST2 dataset. Pruning is performed with the GMP algorithm and using the masked language modeling task based on the BookCorpus and Wikipedia datasets. It achieves 90.5% accuracy on the validation dataset, recovering over 99% of the accuracy of the baseline model. See the included recipe for training instructions.
- Task
- Text Classification
- Library
- transformers
- Type
- distilbert
- Languages
- en
- Created
- Dec 19, 2022
- Updated
- Mar 13, 2024