Downloads · 30 days
6
24% of all-time downloads
classification-flan-t5-large-enriched
sarahahtee/classification-flan-t5-large-enriched
classification-flan-t5-large-enriched is a machine learning model from sarahahtee. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
All-time downloads
25
Public
Repo size
34.2 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.8 MB · 59%
At a glance
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Feb 25, 2024
- Updated
- Feb 25, 2024
- SHA
- 9fcd74ee
Base models
Model card
From the Hugging Face model README
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
classification-flan-t5-large-enriched
This model is a fine-tuned version of google/flan-t5-large on an unknown dataset. It achieves the following results on the evaluation set:
-
Loss: 0.3456
-
Classification Report: precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.5926 0.8000 0.6809 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11
accuracy 0.6500 100 macro avg 0.3476 0.3545 0.3244 100 weighted avg 0.6303 0.6500 0.6070 100
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 7
- eval_batch_size: 7
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 20
Training results
| Training Loss | Epoch | Step | Validation Loss | Classification Report |
|---|---|---|---|---|
| No log | 1.0 | 172 | 1.2904 | precision recall f1-score support |
ALLERGY 0.0000 0.0000 0.0000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.5000 0.1818 0.2667 22 Follow-up 0.0000 0.0000 0.0000 0 GENHX 0.1948 0.7500 0.3093 20 GYNHX 0.0000 0.0000 0.0000 1 HEALTH 0.0000 0.0000 0.0000 0 HEALTHCARE 0.0000 0.0000 0.0000 0 HISTORY 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICAL 0.0000 0.0000 0.0000 0 MEDICATIONS 0.0000 0.0000 0.0000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PAST-HELEN 0.0000 0.0000 0.0000 0 PAST-HELSOX 0.0000 0.0000 0.0000 0 PASTMEDICALHX 0.0000 0.0000 0.0000 4 PASTSURGICAL 0.0000 0.0000 0.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11
accuracy 0.1900 100
macro avg 0.0257 0.0345 0.0213 100
weighted avg 0.1490 0.1900 0.1205 100 | | No log | 2.0 | 344 | 0.8167 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.7143 0.4545 0.5556 22 Follow-UP 0.0000 0.0000 0.0000 0 GENHX 0.2586 0.7500 0.3846 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICAL 0.0000 0.0000 0.0000 0 MEDICALHX 0.0000 0.0000 0.0000 0 MEDICATION 0.0000 0.0000 0.0000 0 MEDICATIONS 0.5000 0.4286 0.4615 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.0000 0.0000 0.0000 4 PASTSURGICAL 0.5000 0.1250 0.2000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 SSRI 0.0000 0.0000 0.0000 0 SURGICAL 0.0000 0.0000 0.0000 0
accuracy 0.3000 100
macro avg 0.1143 0.0772 0.0770 100
weighted avg 0.3239 0.3000 0.2635 100 | | 1.7766 | 3.0 | 516 | 0.6617 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.8235 0.6364 0.7179 22 GENHX 0.3455 0.9500 0.5067 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICALHX 0.0000 0.0000 0.0000 0 MEDICATIONS 0.4545 0.7143 0.5556 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.0000 0.0000 0.0000 4 PASTSURGICAL 0.5000 0.2500 0.3333 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 SSRI 0.0000 0.0000 0.0000 0 SURGICAL 0.0000 0.0000 0.0000 0
accuracy 0.4100 100
macro avg 0.1358 0.1218 0.1093 100
weighted avg 0.3621 0.4100 0.3408 100 | | 1.7766 | 4.0 | 688 | 0.5475 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.8235 0.6364 0.7179 22 GENHX 0.3600 0.9000 0.5143 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5455 0.8571 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.1250 0.2500 0.1667 4 PASTSURGICAL 0.5714 0.5000 0.5333 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 SURGICAL 0.0000 0.0000 0.0000 0
accuracy 0.4400 100
macro avg 0.1631 0.1616 0.1428 100
weighted avg 0.3821 0.4400 0.3728 100 | | 1.7766 | 5.0 | 860 | 0.4635 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9000 0.8182 0.8571 22 GENHX 0.4186 0.9000 0.5714 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.8571 0.7500 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3000 0.7500 0.4286 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11
accuracy 0.5500 100
macro avg 0.2352 0.2231 0.2022 100
weighted avg 0.4815 0.5500 0.4788 100 | | 0.3502 | 6.0 | 1032 | 0.4271 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 1.0000 0.9091 0.9524 22 GENHX 0.5000 0.8500 0.6296 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5000 1.0000 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8000 1.0000 0.8889 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.0909 0.1667 11
accuracy 0.5900 100
macro avg 0.2818 0.2470 0.2171 100
weighted avg 0.6150 0.5900 0.5254 100 | | 0.3502 | 7.0 | 1204 | 0.4207 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 1.0000 0.8182 0.9000 22 GENHX 0.5517 0.8000 0.6531 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5385 1.0000 0.7000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.1818 1.0000 0.3077 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.1818 0.3077 11
accuracy 0.5800 100
macro avg 0.3255 0.2902 0.2595 100
weighted avg 0.6364 0.5800 0.5401 100 | | 0.3502 | 8.0 | 1376 | 0.4131 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.4857 0.8500 0.6182 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5385 1.0000 0.7000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11
accuracy 0.6100 100
macro avg 0.3020 0.2966 0.2728 100
weighted avg 0.5827 0.6100 0.5534 100 | | 0.2592 | 9.0 | 1548 | 0.3828 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.2500 0.2222 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5152 0.8500 0.6415 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5833 1.0000 0.7368 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11
accuracy 0.6200 100
macro avg 0.3069 0.3079 0.2806 100
weighted avg 0.5886 0.6200 0.5628 100 | | 0.2592 | 10.0 | 1720 | 0.3815 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.1667 0.2500 0.2000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5312 0.8500 0.6538 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6364 1.0000 0.7778 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11
accuracy 0.6200 100
macro avg 0.3085 0.3079 0.2820 100
weighted avg 0.5942 0.6200 0.5672 100 | | 0.2592 | 11.0 | 1892 | 0.3728 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5714 0.8000 0.6667 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6364 1.0000 0.7778 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11
accuracy 0.6300 100
macro avg 0.3204 0.3322 0.2996 100
weighted avg 0.6095 0.6300 0.5821 100 | | 0.2124 | 12.0 | 2064 | 0.3739 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5714 0.8000 0.6667 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6364 1.0000 0.7778 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11
accuracy 0.6300 100
macro avg 0.3388 0.3480 0.3146 100
weighted avg 0.6166 0.6300 0.5850 100 | | 0.2124 | 13.0 | 2236 | 0.3561 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5714 0.8000 0.6667 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6364 1.0000 0.7778 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11
accuracy 0.6300 100
macro avg 0.3204 0.3322 0.2996 100
weighted avg 0.6095 0.6300 0.5821 100 | | 0.2124 | 14.0 | 2408 | 0.3784 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5862 0.8500 0.6939 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11
accuracy 0.6400 100
macro avg 0.3295 0.3344 0.3049 100
weighted avg 0.6285 0.6400 0.5964 100 | | 0.1926 | 15.0 | 2580 | 0.3545 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9545 0.9545 0.9545 22 GENHX 0.5862 0.8500 0.6939 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7000 1.0000 0.8235 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11
accuracy 0.6500 100
macro avg 0.3266 0.3365 0.3064 100
weighted avg 0.6196 0.6500 0.5981 100 | | 0.1926 | 16.0 | 2752 | 0.3393 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.1818 0.5000 0.2667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.6250 0.7500 0.6818 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3333 1.0000 0.5000 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11
accuracy 0.6300 100
macro avg 0.3262 0.3340 0.3028 100
weighted avg 0.6332 0.6300 0.5982 100 | | 0.1926 | 17.0 | 2924 | 0.3464 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9545 0.9545 0.9545 22 GENHX 0.5769 0.7500 0.6522 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.3636 0.5000 11
accuracy 0.6500 100
macro avg 0.3312 0.3402 0.3122 100
weighted avg 0.6338 0.6500 0.6131 100 | | 0.1771 | 18.0 | 3096 | 0.3489 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.5926 0.8000 0.6809 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11
accuracy 0.6500 100
macro avg 0.3476 0.3545 0.3244 100
weighted avg 0.6303 0.6500 0.6070 100 | | 0.1771 | 19.0 | 3268 | 0.3489 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.5926 0.8000 0.6809 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11
accuracy 0.6500 100
macro avg 0.3476 0.3545 0.3244 100
weighted avg 0.6303 0.6500 0.6070 100 | | 0.1771 | 20.0 | 3440 | 0.3456 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.5926 0.8000 0.6809 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11
accuracy 0.6500 100
macro avg 0.3476 0.3545 0.3244 100
weighted avg 0.6303 0.6500 0.6070 100 |
Framework versions
- PEFT 0.8.2
- Transformers 4.37.2
- Pytorch 2.1.0+cu121
- Datasets 2.17.1
- Tokenizers 0.15.2
- Library
- peft
- License
- apache-2.0
- Created
- Feb 25, 2024
- Updated
- Feb 25, 2024