Downloads · 30 days
138
9% of all-time downloads
Helsinki-NLP/simple-finnish-gpt3-xl
simple-finnish-gpt3-xl is a text generation model from Helsinki-NLP. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is the Finnish GPT3 XL model (https://huggingface.co/TurkuNLP/gpt3-finnish-xl/) finetuned for simplification. Finetuning was done according to these instructions: https://github.com/spyysalo/instruction-finetune.…
Downloads · 30 days
138
9% of all-time downloads
All-time downloads
1.6K
Public
Parameters
1.5B
24 GB on disk
Likes
2
Public
Click a slice to open those files.
.pt12 GB · 50%
From the Hugging Face model README
This is the Finnish GPT3 XL model (https://huggingface.co/TurkuNLP/gpt3-finnish-xl/) finetuned for simplification. Finetuning was done according to these instructions: https://github.com/spyysalo/instruction-finetune. The instruction for simplification is "Mukauta selkosuomeksi\n\n".
Paper: Towards Automatic Finnish Text Simplification (Dmitrieva & Tiedemann, DeTermIt-WS 2024).
The finetuning data can be obtained here: http://urn.fi/urn:nbn:fi:lb-2024011703. If you wish to replicate the results, you can find the training, validation, and testing sentence pairs' ids in the "splits.zip" archive in this repository. The ids contain the following information: "{regular text id}__{simple text id}__{sentence pair number}".