pegasus-samsum

dosense/pegasus-samsum

pegasus-samsum is a machine learning model from dosense. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

24% of all-time downloads

All-time downloads

Public

Parameters

571M

2.3 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors2.3 GB · 100%

At a glance

Library: transformers
Model type: pegasus
Access: Public
Created: May 18, 2025
Updated: May 18, 2025
SHA: 9d35165d

Base models

google/pegasus-cnn_dailymail

Model card

From the Hugging Face model README

pegasus-samsum

This model is a fine-tuned version of google/pegasus-cnn_dailymail on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 1.4228

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05
train_batch_size: 1
eval_batch_size: 1
seed: 42
gradient_accumulation_steps: 16
total_train_batch_size: 16
optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
lr_scheduler_warmup_steps: 500
num_epochs: 1

Training results

Training Loss	Epoch	Step	Validation Loss
3.2153	0.0109	10	2.5966
2.9496	0.0217	20	2.5595
3.2505	0.0326	30	2.5065
3.1262	0.0434	40	2.4274
2.8421	0.0543	50	2.3320
2.7148	0.0652	60	2.2392
2.5994	0.0760	70	2.1579
2.6505	0.0869	80	2.0776
2.4761	0.0977	90	2.0039
2.5505	0.1086	100	1.9527
2.1564	0.1195	110	1.9061
2.2488	0.1303	120	1.8633
2.1399	0.1412	130	1.8229
2.1177	0.1520	140	1.7878
2.2764	0.1629	150	1.7655
1.9904	0.1738	160	1.7464
1.9908	0.1846	170	1.7293
1.9265	0.1955	180	1.7115
1.8753	0.2064	190	1.6908
1.8792	0.2172	200	1.6749
1.8695	0.2281	210	1.6602
1.8776	0.2389	220	1.6474
1.8557	0.2498	230	1.6333
1.7715	0.2607	240	1.6211
1.783	0.2715	250	1.6118
1.7804	0.2824	260	1.6052
1.7298	0.2932	270	1.5960
1.7373	0.3041	280	1.5860
1.8356	0.3150	290	1.5775
1.6685	0.3258	300	1.5680
1.8286	0.3367	310	1.5616
1.8783	0.3475	320	1.5554
1.8356	0.3584	330	1.5521
1.7362	0.3693	340	1.5460
1.7617	0.3801	350	1.5421
1.6354	0.3910	360	1.5377
1.7396	0.4018	370	1.5315
1.7178	0.4127	380	1.5272
1.7144	0.4236	390	1.5248
1.7309	0.4344	400	1.5192
1.7003	0.4453	410	1.5142
1.6372	0.4561	420	1.5104
1.7462	0.4670	430	1.5058
1.7235	0.4779	440	1.5016
1.6643	0.4887	450	1.5025
1.7226	0.4996	460	1.4938
1.7068	0.5105	470	1.4875
1.626	0.5213	480	1.4866
1.6784	0.5322	490	1.4843
1.6674	0.5430	500	1.4836
1.6622	0.5539	510	1.4824
1.654	0.5648	520	1.4775
1.6911	0.5756	530	1.4736
1.5729	0.5865	540	1.4687
1.6704	0.5973	550	1.4654
1.6982	0.6082	560	1.4613
1.6824	0.6191	570	1.4586
1.6208	0.6299	580	1.4574
1.5453	0.6408	590	1.4557
1.6591	0.6516	600	1.4574
1.5355	0.6625	610	1.4543
1.6337	0.6734	620	1.4545
1.6499	0.6842	630	1.4522
1.6364	0.6951	640	1.4474
1.5504	0.7059	650	1.4456
1.5548	0.7168	660	1.4459
1.5896	0.7277	670	1.4462
1.5626	0.7385	680	1.4417
1.5659	0.7494	690	1.4391
1.6274	0.7602	700	1.4354
1.5954	0.7711	710	1.4352
1.5664	0.7820	720	1.4353
1.5319	0.7928	730	1.4346
1.6593	0.8037	740	1.4341
1.5734	0.8146	750	1.4327
1.5889	0.8254	760	1.4332
1.5453	0.8363	770	1.4346
1.5532	0.8471	780	1.4325
1.5616	0.8580	790	1.4310
1.6338	0.8689	800	1.4296
1.5428	0.8797	810	1.4279
1.6433	0.8906	820	1.4271
1.5936	0.9014	830	1.4262
1.5273	0.9123	840	1.4259
1.573	0.9232	850	1.4259
1.5828	0.9340	860	1.4249
1.5597	0.9449	870	1.4242
1.5178	0.9557	880	1.4235
1.5319	0.9666	890	1.4232
1.5786	0.9775	900	1.4230
1.5232	0.9883	910	1.4229
1.5857	0.9992	920	1.4228

Framework versions

Transformers 4.51.3
Pytorch 2.6.0+cu124
Datasets 3.6.0
Tokenizers 0.21.1

Library: transformers
Type: pegasus
Created: May 18, 2025
Updated: May 18, 2025