flan_T5_MT

13ari/flan_T5_MT

flan_T5_MT is a text classification model from 13ari. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

3% of all-time downloads

All-time downloads

181

Public

Parameters

751M

69.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors3 GB · 100%

At a glance

Task: Text Classification
Library: transformers
License: apache-2.0
Model type: t5
Access: Public
Created: Feb 10, 2025
Updated: Feb 10, 2025
SHA: 4640bcd9

Try a prompt

Base models

google/flan-t5-large

Model card

From the Hugging Face model README

flan_T5_MT

This model is a fine-tuned version of google/flan-t5-large on the None dataset. It achieves the following results on the evaluation set:

Loss: 1.8295
Accuracy: 0.7971
Precision: 0.7988
Recall: 0.7941
F1 score: 0.7965

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0001
train_batch_size: 1
eval_batch_size: 1
seed: 42
optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy	Precision	Recall	F1 score
1.1041	0.2103	2500	0.9414	0.7371	0.7346	0.7424	0.7384
0.8837	0.4205	5000	1.1617	0.7524	0.8994	0.5682	0.6965
0.8923	0.6308	7500	0.9163	0.7871	0.8306	0.7212	0.7720
0.8658	0.8410	10000	1.0822	0.7947	0.8711	0.6918	0.7711
0.7201	1.0513	12500	1.0379	0.7794	0.7838	0.7718	0.7777
0.5277	1.2616	15000	1.1824	0.7994	0.8353	0.7459	0.7881
0.5173	1.4718	17500	1.0692	0.7806	0.7630	0.8141	0.7877
0.45	1.6821	20000	0.9608	0.7906	0.7913	0.7894	0.7903
0.3901	1.8923	22500	1.2113	0.7994	0.8041	0.7918	0.7979
0.2902	2.1026	25000	1.2724	0.7912	0.8098	0.7612	0.7847
0.1808	2.3129	27500	1.4793	0.7994	0.7956	0.8059	0.8007
0.1787	2.5231	30000	1.3220	0.8053	0.8100	0.7976	0.8038
0.1908	2.7334	32500	1.3844	0.8012	0.82	0.7718	0.7952
0.1709	2.9437	35000	1.6708	0.7924	0.7860	0.8035	0.7946
0.1183	3.1539	37500	1.5582	0.7912	0.7809	0.8094	0.7949
0.088	3.3642	40000	1.6673	0.8059	0.8342	0.7635	0.7973
0.0948	3.5744	42500	1.4679	0.8065	0.8318	0.7682	0.7988
0.0863	3.7847	45000	1.5944	0.7935	0.7939	0.7929	0.7934
0.0576	3.9950	47500	1.9939	0.7971	0.8046	0.7847	0.7945
0.0454	4.2052	50000	1.9647	0.7924	0.784	0.8071	0.7954
0.0407	4.4155	52500	1.9074	0.7959	0.7955	0.7965	0.7960
0.0404	4.6257	55000	1.9506	0.8076	0.8257	0.78	0.8022
0.0494	4.8360	57500	1.8295	0.7971	0.7988	0.7941	0.7965

Framework versions

Transformers 4.48.3
Pytorch 2.5.0+cu124
Datasets 3.2.0
Tokenizers 0.21.0

Task: Text Classification
Library: transformers
Type: t5
License: apache-2.0
Created: Feb 10, 2025
Updated: Feb 10, 2025