Downloads · 30 days
13
3% of all-time downloads
pszemraj/long-t5-tglobal-xl-16384-booksci-summary-v1
long-t5-tglobal-xl-16384-booksci-summary-v1 is a machine learning model from pszemraj. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as bsd-3-clause.
This model is a fine-tuned version of pszemraj/long-t5-tglobal-xl-16384-book-summary on the pszemraj/scientificlaysummarisation-elife-norm dataset. It achieves the following results on the evaluation set: - Loss: 1.75…
Downloads · 30 days
13
3% of all-time downloads
All-time downloads
385
Public
Parameters
2.9B
23.3 GB on disk
Likes
1
Public
Click a slice to open those files.
.bin11.7 GB · 50%
From the Hugging Face model README
This model is a fine-tuned version of pszemraj/long-t5-tglobal-xl-16384-book-summary on the pszemraj/scientific_lay_summarisation-elife-norm dataset. It achieves the following results on the evaluation set:
An experiment of further fine-tuning a booksum model on a different dataset. Compare to either the starting checkpoint (linked above) or to the variant only fine-tuned on the scientific lay summaries.
More information needed
the pszemraj/scientific_lay_summarisation-elife-norm dataset, input 16384 tokens then truncate, output 1024 tokens then truncate.
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
|---|---|---|---|---|---|---|---|---|
| 1.9629 | 1.0 | 543 | 1.7637 | 46.6926 | 12.4769 | 21.4364 | 44.4329 | 381.23 |
| 1.8555 | 2.0 | 1086 | 1.7518 | 47.4591 | 12.7287 | 21.5549 | 44.8709 | 384.39 |