Downloads · 30 days
0
sosolee/custom_summarization_dataset
custom_summarization_dataset is a machine learning model from sosolee. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
0
Access
Public
Updated Sep 20, 2024
Repo size
348 KB
Likes
0
Public
Click a slice to open those files.
.arrow348 KB · 99%
From the Hugging Face model README
Custom Text Dataset
This dataset consists of text articles and their corresponding summaries, designed for text summarization tasks.
The training example was manually created, while the test examples were extracted from the existing CNN/Daily Mail dataset.
No extensive preprocessing was done on the data. Articles were taken directly from the CNN/Daily Mail dataset.
from datasets import load_from_disk
train_dataset = load_from_disk('./results/custom_dataset/train')
test_dataset = load_from_disk('./results/custom_dataset/test')