Downloads · 30 days
55
2% of all-time downloads
jackieliu930/bart-large-cnn-samsum
bart-large-cnn-samsum is a summarization model from jackieliu930. Use it when you need a shorter version of a longer text. It is set up for transformers. The card lists the license as apache-2.0.
This model was trained using Amazon SageMaker and the new Hugging Face Deep Learning container. For more information look at: - 🤗 Transformers Documentation: Amazon SageMaker - Example Notebooks - Amazon SageMaker do…
Downloads · 30 days
55
2% of all-time downloads
All-time downloads
2.4K
Public
Repo size
13 GB
Likes
1
Public
Click a slice to open those files.
.pt6.5 GB · 57%
From the Hugging Face model README
bart-large-cnn-samsumThis model was trained using Amazon SageMaker and the new Hugging Face Deep Learning container. For more information look at:
{
"dataset_name": "samsum",
"do_eval": true,
"do_predict": true,
"do_train": true,
"fp16": true,
"learning_rate": 5e-05,
"model_name_or_path": "facebook/bart-large-cnn",
"num_train_epochs": 3,
"output_dir": "/opt/ml/model",
"per_device_eval_batch_size": 4,
"per_device_train_batch_size": 4,
"predict_with_generate": true,
"sagemaker_container_log_level": 20,
"sagemaker_job_name": "huggingface-pytorch-training-2021-09-08-06-40-19-182",
"sagemaker_program": "run_summarization.py",
"sagemaker_region": "us-west-2",
"sagemaker_submit_directory": "s3://sagemaker-us-west-2-847380964353/huggingface-pytorch-training-2021-09-08-06-40-19-182/source/sourcedir.tar.gz",
"seed": 7
}
from transformers import pipeline
summarizer = pipeline("summarization", model="philschmid/bart-large-cnn-samsum")
conversation = '''Jeff: Can I train a 🤗 Transformers model on Amazon SageMaker?
Philipp: Sure you can use the new Hugging Face Deep Learning Container.
Jeff: ok.
Jeff: and how can I get started?
Jeff: where can I find documentation?
Philipp: ok, ok you can find everything here. https://huggingface.co/blog/the-partnership-amazon-sagemaker-and-hugging-face
'''
nlp(conversation)
| key | value |
|---|---|
| eval_rouge1 | 42.059 |
| eval_rouge2 | 21.5509 |
| eval_rougeL | 32.4083 |
| eval_rougeLsum | 39.0015 |
| test_rouge1 | 40.8656 |
| test_rouge2 | 20.3517 |
| test_rougeL | 31.2268 |
| test_rougeLsum | 37.9301 |