Downloads · 30 days
9
8% of all-time downloads
pkbiswas/Bloom-1b1-Summarization-QLoRa
Bloom-1b1-Summarization-QLoRa is a summarization model from pkbiswas. Use it when you need a shorter version of a longer text. It is set up for peft. The card lists the license as bigscience-bloom-rail-1.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
9
8% of all-time downloads
All-time downloads
115
Public
Repo size
52.3 MB
Likes
0
Public
Click a slice to open those files.
.safetensors18.9 MB · 57%
From the Hugging Face model README
This model is a fine-tuned version of bigscience/bloom-1b1 on the scitldr dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 2.6959 | 0.2510 | 500 | 2.7513 |
| 2.6632 | 0.5020 | 1000 | 2.7296 |
| 2.6724 | 0.7530 | 1500 | 2.7230 |
| 2.6625 | 1.0040 | 2000 | 2.7177 |
| 2.5181 | 1.2550 | 2500 | 2.7247 |
| 2.4633 | 1.5060 | 3000 | 2.7230 |
| 2.4341 | 1.7570 | 3500 | 2.7202 |