Downloads · 30 days
0
mT5-small-VT_deplain-apa
vera-8/mT5-small-VT_deplain-apa
mT5-small-VT_deplain-apa is a text generation model from vera-8. Use it when you need the model to write or continue text. It is set up for transformers.
Finetuned mT5-Model for German sentence-level text-simplification.
Access
Public
Updated May 7, 2024
Repo size
153 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors152 MB · 98%
At a glance
- Task
- Text Generation
- Library
- transformers
- Access
- Public
- Created
- May 5, 2024
- Updated
- May 7, 2024
- SHA
- 740350bb
Base models
Datasets
Model card
From the Hugging Face model README
Model Card for mT5-small-VT_deplain-apa
Finetuned mT5-Model for German sentence-level text-simplification.
Model Details
Model Description
- Model type: Encoder-Decoder-Transformer
- Language(s) (NLP): German
- Finetuned from model: google/mT5-small
- Task: Text-Simplification
Training Details
Training Data
DEplain/DEplain-APA-sent Stodden et al. (2023):arXiv:2305.18939
Training Procedure
Parameter-efficient Fine-Tuning with LoRA.
Vocabulary adjusted through Vocabulary Transfer (Mosin et al. (2021): arXiv:2112.14569).
Training Hyperparameters
- Batch Size: 16
- Epochs: 1
- Learning Rate: 0.001
- Optimizer: Adafactor
LoRA Hyperparameters
- R: 32
- Alpha: 64
- Dropout: 0.1
- Target modules: all linear layers
- Task
- Text Generation
- Library
- transformers
- Languages
- de
- Created
- May 5, 2024
- Updated
- May 7, 2024