Italia-GPT

Italia-GPT <img src="https://flagcdn.com/w40/it.png" width="35" style="display: inline; vertical-align: middle; margin-bottom: 44px;">

Italia-GPT is a 1.2B parameter model fine-tuned for native Italian instruction following. By focusing on linguistic nuances and cultural context, this model provides superior fluency compared to standard base models.

---

💎 Performance Overview

Below are the target benchmarks for the CALAMITA and Evalita-LLM frameworks:

---

🛠 Technical Specifications

• Base Architecture: Llama 3.2
• Precision: BFloat16 ($BF16$)
• Weights: Merged Safetensors (Standalone)
• Language Support: Primary: Italian 🇮🇹, Secondary: English 🇺🇸

---

🚀 Usage Guide

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

model_id = "XythicK/Italia-GPT"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id, 
    torch_dtype=torch.bfloat16, 
    device_map="auto"
)

# Native Italian Chat Template
messages = [{"role": "user", "content": "Come si prepara una vera carbonara?"}]
inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to("cuda")
outputs = model.generate(inputs, max_new_tokens=256)

print(tokenizer.decode(outputs[0], skip_special_tokens=True))