Downloads · 30 days
31
3% of all-time downloads
Shobhank-iiitdwd/long-t5-tglobal-base-16384-book-summary
long-t5-tglobal-base-16384-book-summary is a summarization model from Shobhank-iiitdwd. Use it when you need a shorter version of a longer text. It is set up for transformers. The card lists the license as apache-2.0.
- generalizes reasonably well to academic & narrative text.
Downloads · 30 days
31
3% of all-time downloads
All-time downloads
956
Public
Repo size
3 GB
Likes
0
Public
Click a slice to open those files.
.onnx993 MB · 50%
From the Hugging Face model README
Contents
<!-- TOC -->A fine-tuned version of google/long-t5-tglobal-base on the booksum dataset:
Read the paper by Guo et al. here: LongT5: Efficient Text-To-Text Transformer for Long Sequences
Install/update transformers pip install -U transformers
Summarize text with pipeline:
import torch
from transformers import pipeline
summarizer = pipeline(
"summarization",
"Shobhank-iiitdwd/long-t5-tglobal-base-16384-book-summary",
device=0 if torch.cuda.is_available() else -1,
)
long_text = "Here is a lot of text I don't want to read. Replace me"
result = summarizer(long_text)
print(result[0]["summary_text"])
NOTE: early checkpoints of this model were trained on a "smaller" subsection of the dataset as it was filtered for summaries of 1024 characters. This was subsequently caught and adjusted to 1024 tokens and then trained further for 10+ epochs.
The following hyperparameters were used during the most recent training round*:
* Prior training sessions used roughly similar parameters; multiple sessions were required as this takes eons to train