017-microsoft-MiniLM-finetuned-yahoo-800_200

diogopaes10/017-microsoft-MiniLM-finetuned-yahoo-800_200

017-microsoft-MiniLM-finetuned-yahoo-800_200 is a text classification model from diogopaes10. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as mit.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

3% of all-time downloads

All-time downloads

341

Public

Repo size

668 MB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin267 MB · 50%

At a glance

Task: Text Classification
Library: transformers
License: mit
Model type: bert
Access: Public
Created: Jul 23, 2023
Updated: Jul 23, 2023
SHA: fba0c2bb

Try a prompt

Base models

microsoft/MiniLM-L12-H384-uncased

Model card

From the Hugging Face model README

017-microsoft-MiniLM-finetuned-yahoo-800_200

This model is a fine-tuned version of microsoft/MiniLM-L12-H384-uncased on the None dataset. It achieves the following results on the evaluation set:

Loss: 1.4048
F1: 0.6237
Accuracy: 0.63
Precision: 0.6273
Recall: 0.63
System Ram Used: 3.8778
System Ram Total: 83.4807
Gpu Ram Allocated: 0.3903
Gpu Ram Cached: 12.8340
Gpu Ram Total: 39.5640
Gpu Utilization: 32
Disk Space Used: 25.4337
Disk Space Total: 78.1898

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 32
eval_batch_size: 32
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 25

Training results

Training Loss	Epoch	Step	Validation Loss	F1	Accuracy	Precision	Recall	System Ram Used	System Ram Total	Gpu Ram Allocated	Gpu Ram Cached	Gpu Ram Total	Gpu Utilization	Disk Space Used	Disk Space Total
2.3021	1.28	32	2.2975	0.0519	0.12	0.1102	0.12	3.8424	83.4807	0.3904	12.8340	39.5640	29	24.5606	78.1898
2.2615	2.56	64	2.1926	0.2339	0.31	0.4649	0.31	3.8514	83.4807	0.3904	12.8340	39.5640	30	24.5606	78.1898
2.0677	3.84	96	1.9658	0.4301	0.51	0.3950	0.51	3.8537	83.4807	0.3905	12.8340	39.5640	22	24.5606	78.1898
1.8562	5.12	128	1.8383	0.4655	0.545	0.4587	0.545	3.8574	83.4807	0.3904	12.8340	39.5640	41	24.5606	78.1898
1.6929	6.4	160	1.7403	0.4942	0.555	0.5261	0.555	3.8549	83.4807	0.3904	12.8340	39.5640	29	24.5607	78.1898
1.5569	7.68	192	1.6663	0.5467	0.585	0.6496	0.585	3.8549	83.4807	0.3904	12.8340	39.5640	37	24.5607	78.1898
1.4636	8.96	224	1.6123	0.5475	0.58	0.5539	0.58	3.8539	83.4807	0.3904	12.8340	39.5640	30	24.5607	78.1898
1.3683	10.24	256	1.5615	0.5829	0.595	0.6016	0.595	3.8527	83.4807	0.3904	12.8340	39.5640	41	24.5607	78.1898
1.2649	11.52	288	1.5261	0.5904	0.61	0.6243	0.61	3.8646	83.4807	0.3904	12.8340	39.5640	30	24.5607	78.1898
1.1968	12.8	320	1.4976	0.6012	0.615	0.6070	0.615	3.8766	83.4807	0.3904	12.8340	39.5640	45	24.5607	78.1898
1.1291	14.08	352	1.4756	0.5983	0.615	0.6164	0.615	3.8749	83.4807	0.3905	12.8340	39.5640	47	24.5607	78.1898
1.0673	15.36	384	1.4660	0.6064	0.62	0.6258	0.62	3.8752	83.4807	0.3907	12.8340	39.5640	35	24.5607	78.1898
0.9884	16.64	416	1.4410	0.6135	0.625	0.6204	0.625	3.8757	83.4807	0.3904	12.8340	39.5640	33	24.5608	78.1898
0.9743	17.92	448	1.4328	0.6233	0.635	0.6343	0.635	3.8747	83.4807	0.3905	12.8340	39.5640	44	24.5608	78.1898
0.926	19.2	480	1.4344	0.6088	0.615	0.6238	0.615	3.8742	83.4807	0.3904	12.8340	39.5640	31	24.5608	78.1898
0.8815	20.48	512	1.4282	0.6235	0.625	0.6350	0.625	4.0591	83.4807	0.3904	12.8340	39.5640	43	25.4337	78.1898
0.8613	21.76	544	1.4146	0.6329	0.635	0.6408	0.635	4.0655	83.4807	0.3904	12.8340	39.5640	26	25.4337	78.1898
0.8466	23.04	576	1.4086	0.6318	0.635	0.6415	0.635	4.0544	83.4807	0.3904	12.8340	39.5640	35	25.4337	78.1898
0.8282	24.32	608	1.4058	0.6243	0.63	0.6319	0.63	3.8886	83.4807	0.3904	12.8340	39.5640	27	25.4337	78.1898

Framework versions

Transformers 4.31.0
Pytorch 2.0.1+cu118
Datasets 2.13.1
Tokenizers 0.13.3

Task: Text Classification
Library: transformers
Type: bert
License: mit
Created: Jul 23, 2023
Updated: Jul 23, 2023