Downloads · 30 days
9
8% of all-time downloads
italian-laws-title-extraction
andre156/italian-laws-title-extraction
italian-laws-title-extraction is a text generation model from andre156. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
A Mistral-7B-instruct-v0.1 model to extract a title from the text of Italian law articles. It is fine-tuned over a set of 100k text-title pairs that are available throughout the Italian legislation. It can be used to…
All-time downloads
118
Public
Repo size
655 MB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.pt218 MB · 66%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Aug 22, 2024
- Updated
- Aug 24, 2024
- SHA
- 1c89313a
Base models
Model card
From the Hugging Face model README
Model Description
A Mistral-7B-instruct-v0.1 model to extract a title from the text of Italian law articles. It is fine-tuned over a set of 100k text-title pairs that are available throughout the Italian legislation. It can be used to extract titles for articles or attachments that do not have a pre-defined title.
- Developed by: Andrea Colombo, Politecnico di Milano
- Model type: text generation
- Language(s) (NLP): Italian
- License: Apache 2.0
- Finetuned from model: mistralai/Mistral-7B-Instruct-v0.1
Training Details
Training Procedure
The model has been trained for 100 training steps with batch size 4, 4-bit quantization using bitsandbytes and a LoRA rank of 64. We use the paged Adam optimizer, a learning rate of 0.004, and a cosine learning rate scheduler with a 0.03 warm-up fraction.
Evaluation
The best model reported an evaluation loss of 1.0030452013015747
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Languages
- it
- Created
- Aug 22, 2024
- Updated
- Aug 24, 2024