Downloads · 30 days
11
100% of all-time downloads
distilbert-mnli
Hooshaai/distilbert-mnli
distilbert-mnli is a text classification model from Hooshaai. Use it when you need a label for a piece of text. The card lists the license as mit.
This checkpoint was fully fine-tuned (backbone + head) on the full MNLI training set as part of the A3 SVD compression project.
All-time downloads
11
Public
Parameters
67M
268 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors268 MB · 100%
At a glance
- Task
- Text Classification
- License
- mit
- Model type
- distilbert
- Access
- Public
- Created
- Sep 19, 2026
- Updated
- Sep 19, 2026
- SHA
- 33433d14
Try a prompt
Model card
From the Hugging Face model README
DistilBERT fine-tuned on MNLI
This checkpoint was fully fine-tuned (backbone + head) on the full MNLI training set as part of the A3 SVD compression project.
Results
| Metric | Value |
|---|---|
| Accuracy | 0.8211 |
| F1 (macro) | 0.8202 |
Training Details
- Base model:
distilbert-base-uncased - Epochs: 3
- Learning rate: 4e-05
- Batch size: 128
- Train samples: 392,702
- Val samples: 9,815
Usage
from transformers import AutoModelForSequenceClassification, AutoTokenizer
model = AutoModelForSequenceClassification.from_pretrained("TahaaaaM/distilbert-mnli-a3")
tokenizer = AutoTokenizer.from_pretrained("TahaaaaM/distilbert-mnli-a3")
Citation
Part of the A3 SVD transformer compression research framework.
- Task
- Text Classification
- Type
- distilbert
- License
- mit
- Languages
- en
- Created
- Sep 19, 2026
- Updated
- Sep 19, 2026