Downloads · 30 days
5
15% of all-time downloads
t5-finetune-health
la-min/t5-finetune-health
t5-finetune-health is a machine learning model from la-min. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
All-time downloads
34
Public
Parameters
248M
991 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors990 MB · 100%
At a glance
- Library
- transformers
- License
- mit
- Model type
- t5
- Access
- Public
- Created
- Dec 27, 2023
- Updated
- Dec 27, 2023
- SHA
- 5aca51e1
Model card
From the Hugging Face model README
license: apache-2.0 base_model: google/flan-t5-base tags:
- generated_from_trainer datasets:
- medical_q&a
flan-t5-base-finetuned-medical_q&a
This model is a fine-tuned version of google/flan-t5-base on the medical_q&a dataset.
Model description
When using the model input question, please add "Please answer this question:"
Training hyperparameters
The following hyperparameters were used during training:
- L_RATE = 3e-4
- BATCH_SIZE = 3
- PER_DEVICE_EVAL_BATCH = 4
- WEIGHT_DECAY = 0.01
- SAVE_TOTAL_LIM = 3
- NUM_EPOCHS = 3
Training results
| Training Loss | Epoch | Validation Loss |
|---|---|---|
| 1.757200 | 1.0 | 1.453026 |
| 1.549100 | 2.0 | 1.313304 |
| 1.474500 | 3.0 | 1.264468 |
Framework versions
- Transformers 4.31.0
- Pytorch 2.0.1+cu118
- Datasets 2.14.0
- Tokenizers 0.13.3
- Library
- transformers
- Type
- t5
- License
- mit
- Created
- Dec 27, 2023
- Updated
- Dec 27, 2023