Downloads · 30 days
26
50% of all-time downloads
Kamyar-zeinalipour/llama13B_turkish_crossword_clue_gen
llama13B_turkish_crossword_clue_gen is a text generation model from Kamyar-zeinalipour. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as llama2.
Downloads · 30 days
26
50% of all-time downloads
All-time downloads
52
Public
Repo size
2.3 GB
Likes
0
Public
Click a slice to open those files.
.safetensors783 MB · 100%
From the Hugging Face model README
Llama-2-13b-chat fine-tuned to write Turkish crossword clues
</div>Given a Turkish text, a keyword and a category, this model writes a crossword clue for that keyword. It is a LoRA adapter (r = 16, α = 32, learning rate 1e-4, 3 epochs) for Llama-2-13b-chat trained on T4TAC, from the paper A Turkish Educational Crossword Puzzle Generator (AIED 2024).
The generator script in the GitHub repository handles prompting and parsing:
git clone https://github.com/KamyarZeinalipour/CW_Clue_Gen_tr && cd CW_Clue_Gen_tr
python gen_main.py --help
ROUGE scores of generated clues against GPT-4-Turbo references:
| Model | ROUGE-1 | ROUGE-2 | ROUGE-L |
|---|---|---|---|
| GPT-3.5-Turbo (base) | 24.57 | 8.48 | 16.61 |
| Llama-2-7b-chat, fine-tuned | 22.50 | 5.00 | 14.80 |
| Llama-2-13b-chat, fine-tuned | 25.66 | 6.45 | 17.24 |
| GPT-3.5-Turbo, fine-tuned | 39.96 | 18.08 | 23.48 |
| Model | Adapter |
|---|---|
| Llama-2-7b-chat | llama7B_turkish_crossword_clue_gen |
| Llama-2-13b-chat | llama13B_turkish_crossword_clue_gen |
@inproceedings{zeinalipour2024turkishcrossword,
title = {A Turkish Educational Crossword Puzzle Generator},
author = {Kamyar Zeinalipour and Yusuf Gokberk Keptig and Marco Maggini and Leonardo Rigutini and Marco Gori},
booktitle = {Artificial Intelligence in Education (AIED 2024), Posters and Late Breaking Results},
year = {2024},
url = {https://arxiv.org/abs/2405.07035}
}
Released under the Llama 2 Community License, as a derivative of Llama-2-13b-chat.