Downloads · 30 days
8
11% of all-time downloads
pszemraj/long-t5-tglobal-xl-16384-booksci-summary-plos-10k
long-t5-tglobal-xl-16384-booksci-summary-plos-10k is a machine learning model from pszemraj. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as bsd-3-clause.
This model is a fine-tuned version of pszemraj/long-t5-tglobal-xl-16384-book-summary on the pszemraj/scientificlaysummarisation-plos-norm dataset. It achieves the following results on the evaluation set: - Loss: 1.504…
Downloads · 30 days
8
11% of all-time downloads
All-time downloads
74
Public
Parameters
2.9B
23.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.bin11.7 GB · 50%
From the Hugging Face model README
This model is a fine-tuned version of pszemraj/long-t5-tglobal-xl-16384-book-summary on the pszemraj/scientific_lay_summarisation-plos-norm dataset. It achieves the following results on the evaluation set:
Another test of further fine-tuning booksum-based models, this one fine-tuned on the PLOS subset of lay-summaries for about 10k examples input, to make it roughly equivalent to this checkpoint fine-tuned on the ELIFE subset for two epochs (also around 10k examples).
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
|---|---|---|---|---|---|---|---|---|
| 1.7715 | 0.28 | 350 | 1.5310 | 43.4729 | 10.4616 | 22.1928 | 39.505 | 260.87 |
| 1.9307 | 0.56 | 700 | 1.5102 | 44.1634 | 10.9336 | 22.3896 | 40.2939 | 253.58 |
| 1.2981 | 0.84 | 1050 | 1.5046 | 44.2728 | 10.8455 | 22.4122 | 40.3019 | 261.29 |