Downloads · 30 days
24
6% of all-time downloads
led-base-16384
johngiorgi/led-base-16384
led-base-16384 is a summarization model from johngiorgi. Use it when you need a shorter version of a longer text. It is set up for transformers. The card lists the license as apache-2.0.
This model is identical to allenai/led-base-16384, except the generationconfig.json has been updated from:
All-time downloads
429
Public
Repo size
1.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin648 MB · 99%
At a glance
- Task
- Summarization
- Library
- transformers
- License
- apache-2.0
- Model type
- led
- Access
- Public
- Created
- Apr 5, 2023
- Updated
- Apr 5, 2023
- SHA
- 28d2d389
Try a prompt
Model card
From the Hugging Face model README
Model Card
This model is identical to allenai/led-base-16384, except the generation_config.json has been updated from:
{
"_from_model_config": true,
"bos_token_id": 0,
"decoder_start_token_id": 2,
"eos_token_id": 2,
"pad_token_id": 1
}
to
{
"bos_token_id": 0,
"decoder_start_token_id": 2,
"eos_token_id": 2,
"pad_token_id": 1,
"early_stopping": true,
"length_penalty": 2.0,
"max_length": 512,
"min_length": 100,
"no_repeat_ngram_size": 3,
"num_beams": 4
}
which we found to be much more stable when fine-tuning the model for summarization tasks.
- Task
- Summarization
- Library
- transformers
- Type
- led
- License
- apache-2.0
- Languages
- en
- Created
- Apr 5, 2023
- Updated
- Apr 5, 2023