flan-t5-large-da-multiwoz2.1_fs0.01

Zekunli/flan-t5-large-da-multiwoz2.1_fs0.01

flan-t5-large-da-multiwoz2.1_fs0.01 is a machine learning model from Zekunli. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

6% of all-time downloads

All-time downloads

209

Public

Repo size

18.8 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin3.1 GB · 100%

At a glance

Library: transformers
Model type: t5
Access: Public
Created: Feb 19, 2023
Updated: Feb 19, 2023
SHA: f00b811a

Model card

From the Hugging Face model README

flan-t5-large-da-multiwoz2.1_fs0.01

This model was trained from scratch on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.4733
Accuracy: 35.7018
Num: 3689
Gen Len: 16.0656

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 24
seed: 1799
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 20

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy	Num	Gen Len
0.4198	2.6	200	0.4959	33.3159	3689	17.0976
0.3487	5.19	400	0.5050	33.9202	3689	16.9694
0.4306	7.79	600	0.4597	34.2354	3689	16.7612
0.38	10.39	800	0.4668	35.3878	3689	16.5993
0.3563	12.99	1000	0.4622	34.9845	3689	15.743
0.3208	15.58	1200	0.4668	35.6226	3689	16.1944
0.3137	18.18	1400	0.4733	35.7018	3689	16.0656

Framework versions

Transformers 4.18.0
Pytorch 1.10.0+cu111
Datasets 2.5.1
Tokenizers 0.12.1

Library: transformers
Type: t5
Created: Feb 19, 2023
Updated: Feb 19, 2023