Downloads · 30 days
5
2% of all-time downloads
flan-t5-small-samsum-3
guy-smiley/flan-t5-small-samsum-3
flan-t5-small-samsum-3 is a machine learning model from guy-smiley. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
A version of google/flan-t5-small, fine-tuned on the samsum dataset.
All-time downloads
247
Public
Parameters
77M
309 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors308 MB · 99%
At a glance
- Library
- transformers
- Model type
- t5
- Access
- Public
- Created
- Feb 12, 2024
- Updated
- Mar 6, 2024
- SHA
- eebb08a1
Datasets
Model card
From the Hugging Face model README
Model Card for Model ID
A version of google/flan-t5-small, fine-tuned on the samsum dataset.
Model Details
Model Description
- Developed by: guy-smiley
- Model type: Language model
- Language(s) (NLP): English
- Finetuned from model: flan-t5-small
Uses
Chat and dialogue summarization
Bias, Risks, and Limitations
"Language models, including Flan-T5, can potentially be used for language generation in a harmful way, according to Rae et al. (2021). Flan-T5 should not be used directly in any application, without a prior assessment of safety and fairness concerns specific to the application."
Training Details
Training Data
Training Procedure
- Trained with Seq2Se2Trainer
- GitHub repo:
Training Hyperparameters
- learning_rate: 0.00005
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 1
Training Results
- epoch: 1
- train_loss: 1.83195
- eval
- eval_loss: 1.67304
- eval_rouge1: 42.8081
- eval_rouge2: 18.6456
- eval_rougeL: 35.4345
- eval_rougeLsum: 39.1534
- Library
- transformers
- Type
- t5
- Created
- Feb 12, 2024
- Updated
- Mar 6, 2024