t5-dialogue-classification-3

veronica-girolimetti/t5-dialogue-classification-3

t5-dialogue-classification-3 is a machine learning model from veronica-girolimetti. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

33% of all-time downloads

All-time downloads

Public

Parameters

77M

4.3 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors308 MB · 99%

At a glance

Library: transformers
License: apache-2.0
Model type: t5
Access: Public
Created: Jan 10, 2024
Updated: Jan 10, 2024
SHA: 5e9964c6

Base models

google/flan-t5-small

Model card

From the Hugging Face model README

t5-dialogue-classification-3

This model is a fine-tuned version of google/flan-t5-small on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.6790
Classification Report: precision recall f1-score support
```
ALLERGY     1.0000    0.5000    0.6667         4
```
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 0.5000 0.6667 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8000 0.8000 0.8000 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

accuracy 0.7100 100 macro avg 0.4514 0.4761 0.4402 100 weighted avg 0.6892 0.7100 0.6853 100

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0001
train_batch_size: 7
eval_batch_size: 7
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 20

Training results

Training Loss	Epoch	Step	Validation Loss	Classification Report
No log	1.0	172	0.5176	precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.2500 0.2500 0.2500 4 CC 0.4286 0.7500 0.5455 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.5000 0.3333 0.4000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8696 0.9091 0.8889 22 GENHX 0.7083 0.8500 0.7727 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.6900       100
macro avg     0.4173    0.4347    0.4004       100

weighted avg 0.6814 0.6900 0.6680 100 | | No log | 2.0 | 344 | 0.5183 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 1.0000 0.2500 0.4000 4 CC 0.3750 0.7500 0.5000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.5000 0.3333 0.4000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.7391 0.8500 0.7907 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7300       100
macro avg     0.4976    0.4630    0.4343       100

weighted avg 0.7341 0.7300 0.6967 100 | | 0.0335 | 3.0 | 516 | 0.5484 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.6800 0.8500 0.7556 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3750 0.7500 0.5000 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11

 accuracy                         0.7000       100
macro avg     0.3966    0.4376    0.4016       100

weighted avg 0.6475 0.7000 0.6590 100 | | 0.0335 | 4.0 | 688 | 0.5881 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 1.0000 0.2500 0.4000 4 CC 0.7500 0.7500 0.7500 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.5000 0.3333 0.4000 3 EXAM 0.2000 1.0000 0.3333 1 FAM/SOCHX 0.8750 0.9545 0.9130 22 GENHX 0.7391 0.8500 0.7907 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 0.7143 0.7692 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7200       100
macro avg     0.4781    0.4744    0.4386       100

weighted avg 0.7290 0.7200 0.7001 100 | | 0.0335 | 5.0 | 860 | 0.5719 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 1.0000 0.2500 0.4000 4 CC 0.6000 0.7500 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 0.5000 0.6667 2 EDCOURSE 0.5000 0.3333 0.4000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.7727 0.8500 0.8095 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 0.7143 0.7692 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7500       100
macro avg     0.5441    0.5100    0.4939       100

weighted avg 0.7564 0.7500 0.7280 100 | | 0.0168 | 6.0 | 1032 | 0.6716 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2143 0.7500 0.3333 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.9167 1.0000 0.9565 22 GENHX 0.8824 0.7500 0.8108 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3333 0.7500 0.4615 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.6800       100
macro avg     0.3618    0.3967    0.3570       100

weighted avg 0.6812 0.6800 0.6627 100 | | 0.0168 | 7.0 | 1204 | 0.5918 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6000 0.7500 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.7727 0.8500 0.8095 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 0.7500 0.6000 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7100       100
macro avg     0.3971    0.4517    0.4035       100

weighted avg 0.6691 0.7100 0.6776 100 | | 0.0168 | 8.0 | 1376 | 0.6426 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.3333 0.7500 0.4615 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.7391 0.8500 0.7907 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4286 0.7500 0.5455 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.3333 0.3333 0.3333 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.6800       100
macro avg     0.3374    0.3744    0.3401       100

weighted avg 0.6542 0.6800 0.6548 100 | | 0.0098 | 9.0 | 1548 | 0.6204 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6000 0.7500 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 0.5000 0.6667 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.8000 0.8000 0.8000 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.8571 0.7500 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7300       100
macro avg     0.4561    0.4855    0.4463       100

weighted avg 0.6953 0.7300 0.6968 100 | | 0.0098 | 10.0 | 1720 | 0.6086 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.3333 0.2500 0.2857 4 CC 0.6000 0.7500 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8750 0.9545 0.9130 22 GENHX 0.7273 0.8000 0.7619 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 0.7143 0.7692 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.3333 0.3333 0.3333 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7000       100
macro avg     0.4183    0.4469    0.4156       100

weighted avg 0.6820 0.7000 0.6777 100 | | 0.0098 | 11.0 | 1892 | 0.6412 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8000 0.8000 0.8000 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.8571 0.7500 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7000       100
macro avg     0.3985    0.4416    0.4013       100

weighted avg 0.6648 0.7000 0.6676 100 | | 0.0056 | 12.0 | 2064 | 0.5978 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6000 0.7500 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 0.5000 0.6667 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8750 0.9545 0.9130 22 GENHX 0.7619 0.8000 0.7805 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.8571 0.7500 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8000 1.0000 0.8889 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7100       100
macro avg     0.4512    0.4666    0.4376       100

weighted avg 0.6836 0.7100 0.6816 100 | | 0.0056 | 13.0 | 2236 | 0.6510 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6000 0.7500 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.7273 0.8000 0.7619 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7000       100
macro avg     0.4265    0.4594    0.4256       100

weighted avg 0.6774 0.7000 0.6756 100 | | 0.0056 | 14.0 | 2408 | 0.6665 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8750 0.9545 0.9130 22 GENHX 0.8000 0.8000 0.8000 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7000       100
macro avg     0.4232    0.4594    0.4231       100

weighted avg 0.6796 0.7000 0.6761 100 | | 0.0054 | 15.0 | 2580 | 0.6430 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

 accuracy                         0.7000       100
macro avg     0.4265    0.4594    0.4256       100

weighted avg 0.6774 0.7000 0.6756 100 | | 0.0054 | 16.0 | 2752 | 0.6588 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 0.5000 0.6667 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.7619 0.8000 0.7805 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7100       100
macro avg     0.4565    0.4761    0.4448       100

weighted avg 0.6954 0.7100 0.6880 100 | | 0.0054 | 17.0 | 2924 | 0.6742 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 0.5000 0.4000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8000 0.8000 0.8000 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7000       100
macro avg     0.4181    0.4594    0.4219       100

weighted avg 0.6726 0.7000 0.6736 100 | | 0.0026 | 18.0 | 3096 | 0.6810 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 0.5000 0.6667 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8000 0.8000 0.8000 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7000       100
macro avg     0.4467    0.4594    0.4299       100

weighted avg 0.6871 0.7000 0.6797 100 | | 0.0026 | 19.0 | 3268 | 0.6769 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 0.5000 0.6667 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8000 0.8000 0.8000 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7000       100
macro avg     0.4431    0.4594    0.4269       100

weighted avg 0.6842 0.7000 0.6773 100 | | 0.0026 | 20.0 | 3440 | 0.6790 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 0.5000 0.6667 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.8000 0.8000 0.8000 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11

 accuracy                         0.7100       100
macro avg     0.4514    0.4761    0.4402       100

weighted avg 0.6892 0.7100 0.6853 100 |

Framework versions

Transformers 4.35.2
Pytorch 2.1.0+cu121
Datasets 2.16.1
Tokenizers 0.15.0

Library: transformers
Type: t5
License: apache-2.0
Created: Jan 10, 2024
Updated: Jan 10, 2024