Downloads · 30 days
0
donotdelete
fxmarty/donotdelete
donotdelete is a machine learning model from fxmarty. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Fixed parameters: modelnameorpath: Bhumika/roberta-base-finetuned-sst2 dataset: path: glue name: sst2 calibrationsplit: None evalsplit: validation datakeys: ['sentence'] labelkeys: ['label'] quantizationapproach: dyna…
Access
Public
Updated May 11, 2022
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json7 KB · 72%
At a glance
- Access
- Public
- Created
- May 11, 2022
- Updated
- May 11, 2022
- SHA
- af7a81c0
Model card
From the Hugging Face model README
Fixed parameters:
- model_name_or_path:
Bhumika/roberta-base-finetuned-sst2 - dataset:
- path:
glue - name:
sst2 - calibration_split:
None - eval_split:
validation - data_keys:
['sentence'] - label_keys:
['label']
- path:
- quantization_approach:
dynamic - node_exclusion:
[] - per_channel:
False - calibration:
None - framework:
onnxruntime - framework_args:
- opset:
15 - optimization_level:
1
- opset:
- aware_training:
False
Benchmarked parameters:
- operators_to_quantize:
['Add', 'MatMul'],['Add']
Evaluation
Below, time metrics for
- Batch size: 8
- Input length: 128
| operators_to_quantize | | latency_mean (original, ms) | latency_mean (optimized, ms) | | throughput (original, /s) | throughput (optimized, /s) | | accuracy (original) | accuracy (optimized) |
| :-------------------: | :-: | :-------------------------: | :--------------------------: | :-: | :-----------------------: | :------------------------: | :-: | :-----------------: | :------------------: |
|
['Add']| | | 454.70 | 361.81 | | | 2.50 | 3.00 | | | 1.0 | 1.0 | |['Add', 'MatMul']| | | 474.54 | 135.14 | | | 2.50 | 7.50 | | | 1.0 | 1.0 |
- Created
- May 11, 2022
- Updated
- May 11, 2022