tinyllama-kalevala-chat

TinyLlama Kalevala Chat Model

This is a fine-tuned version of TinyLlama/TinyLlama-1.1B-Chat, adapted to answer questions about the Finnish national epic, the Kalevala. The model was fine-tuned using LoRA (Low-Rank Adaptation) on a curated dataset of prompt-response pairs derived from the Kalevala's characters, events, and symbolism.

🧠 Model Description

• Base model: TinyLlama-1.1B-Chat
• Parameter count: 1.1B
• Fine-tuning method: LoRA using Hugging Face Transformers and PEFT
• Dataset: nraesalmi/kalevala-dataset, consisting of 300 structured prompt-response pairs
• Language: English (with content related to Finnish culture and mythology)

🗃️ Example Usage

from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline

model = AutoModelForCausalLM.from_pretrained("nraesalmi/tinyllama-kalevala-chat")
tokenizer = AutoTokenizer.from_pretrained("nraesalmi/tinyllama-kalevala-chat")

chat = pipeline("text-generation", model=model, tokenizer=tokenizer)
chat("Tell me about the Sampo in the Kalevala:")

🧾 Example Output

"The Sampo is a magical artifact in the Kalevala, forged by the smith Ilmarinen. It brings prosperity by grinding out salt, grain, and gold. The struggle for control of the Sampo is a central theme in the epic."

📚 Intended Use

This model is intended for educational, cultural, and research purposes related to Finnish literature and mythology. It may also be useful for generating creative narratives or teaching materials about the Kalevala.

🛑 Limitations

The model may hallucinate or provide incorrect historical details outside its fine-tuned scope.

While aligned to be informative, it does not always follow factual sources beyond its training data.

📜 License

The model follows the same license as the original TinyLlama base model (Apache 2.0). The fine-tuning dataset is public domain or derived from freely accessible summaries and interpretations of the Kalevala.

✍️ Author

Fine-tuned and published by nraesalmi