Downloads · 30 days
23
0% of all-time downloads
INC4AI/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc
distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc is a text classification model from INC4AI. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.
- Model Details - How to Get Started With the Model
Downloads · 30 days
23
0% of all-time downloads
All-time downloads
4.7K
Public
Repo size
388 MB
Likes
1
Public
Click a slice to open those files.
.onnx172 MB · 55%
From the Hugging Face model README
Model Description: This model is a DistilBERT fine-tuned on SST-2 dynamically quantized with optimum-intel through the usage of huggingface/optimum-intel through the usage of Intel® Neural Compressor.
To load the quantized model, you can do as follows:
from optimum.intel import INCModelForSequenceClassification
model_id = "distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc"
model = INCModelForSequenceClassification.from_pretrained(model_id)
This is an INT8 ONNX model quantized with Intel® Neural Compressor.
The original fp32 model comes from the fine-tuned model DistilBERT.
| INT8 | FP32 | |
|---|---|---|
| Accuracy (eval-accuracy) | 0.9025 | 0.9106 |
| Model size (MB) | 165 | 256 |
from optimum.onnxruntime import ORTModelForSequenceClassification
model = ORTModelForSequenceClassification.from_pretrained('Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic')