Downloads · 30 days
38
24% of all-time downloads
overthelex/qwen2.5-0.5b-edrsr-legal-uk
qwen2.5-0.5b-edrsr-legal-uk is a text generation model from overthelex. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Ukrainian legal domain model obtained by continued pretraining (CPT) of Qwen2.5-0.5B on the EDRSR corpus of Ukrainian court decisions.
Downloads · 30 days
38
24% of all-time downloads
All-time downloads
156
Public
Parameters
494M
1000 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors988 MB · 99%
From the Hugging Face model README
Ukrainian legal domain model obtained by continued pretraining (CPT) of Qwen2.5-0.5B on the EDRSR corpus of Ukrainian court decisions.
Part of a scaling experiment (0.5B / 1.5B / 3B) for the PhD dissertation at Glushkov Institute of Cybernetics, NAS of Ukraine.
| Metric | Value |
|---|---|
| Initial loss (step 10) | 1.5254 |
| Final loss (step 9,536) | 0.2633 |
| Loss reduction | -83% |
| Train loss (avg) | 0.3117 |
| Total FLOPs | 2.65e18 |
This is a base model (not instruction-tuned). It is intended for: