Downloads · 30 days
22
3% of all-time downloads
distilbart-ftn-wiki_lingua
datien228/distilbart-ftn-wiki_lingua
distilbart-ftn-wiki_lingua is a summarization model from datien228. Use it when you need a shorter version of a longer text. It is set up for transformers. The card lists the license as mit.
The repository for the fine-tuned BART model (by sshleifer) using the wikilingua dataset (English)
All-time downloads
655
Public
Repo size
4.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.2 GB · 100%
At a glance
- Task
- Summarization
- Library
- transformers
- License
- mit
- Model type
- bart
- Access
- Public
- Created
- Jul 3, 2022
- Updated
- Jul 5, 2022
- SHA
- 3f7f4c27
Try a prompt
Datasets
Model card
From the Hugging Face model README
Pre-trained BART Model fine-tune on WikiLingua dataset
The repository for the fine-tuned BART model (by sshleifer) using the wiki_lingua dataset (English)
Purpose: Examine the performance of a fine-tuned model research purposes
Observation:
- Pre-trained model was trained on the XSum dataset, which summarize a not-too-long documents into one-liner summary
- Fine-tuning this model using WikiLingua is appropriate since the summaries for that dataset are also short
- In the end, however, the model cannot capture much clearer key points, but instead it mostly extracts the opening sentence
- Some data pre-processing and models' hyperparameter are also need to be tuned more properly.
- Task
- Summarization
- Library
- transformers
- Type
- bart
- License
- mit
- Languages
- en
- Created
- Jul 3, 2022
- Updated
- Jul 5, 2022