Downloads · 30 days
0
Hodfa71/gpt-sw3-356m-is-saga-delta-dpo
gpt-sw3-356m-is-saga-delta-dpo is a text generation model from Hodfa71. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as other.
Fine-tuned with SAGA (Syntax-Aware Grammar Alignment), a two-stage pipeline that trains language models to generate grammatically correct Icelandic text using reinforcement learning from a symbolic parser oracle (Grey…
Downloads · 30 days
0
Access
Public
Updated Apr 15, 2026
Parameters
370M
741 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors740 MB · 100%
From the Hugging Face model README
Fine-tuned with SAGA (Syntax-Aware Grammar Alignment), a two-stage pipeline that trains language models to generate grammatically correct Icelandic text using reinforcement learning from a symbolic parser oracle (Greynir (Icelandic constituency parser)).
This is a fully merged model — no PEFT setup needed.
Stage 1: SFT on parser-verified Icelandic Wikipedia (base PS 72.5% < 80% threshold). Stage 2: Δ-DPO from SFT checkpoint.
| Metric | Base | + Δ-DPO |
|---|---|---|
| Parse success | 72.5% | 79.0% |
| Parse score | 0.341 | 0.500 |
| PPL-Wiki | 22.9 | 14.6 |
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained('{Hodfa71/gpt-sw3-356m-is-saga-delta-dpo}')
tokenizer = AutoTokenizer.from_pretrained("{Hodfa71/gpt-sw3-356m-is-saga-delta-dpo}")
prompt = "Íslenska er"
inputs = tokenizer(prompt, return_tensors="pt")
output = model.generate(**inputs, max_new_tokens=60, temperature=0.8, do_sample=True)
print(tokenizer.decode(output[0], skip_special_tokens=True))
@article{fakhar2025saga,
title={SAGA: Syntax-Aware Grammar Alignment for Low-Resource Nordic Languages},
author={Fakhar, Hoda and others},
year={2025},
note={Under review}
}
Inherits the base model license (AI Sweden LLM License / LumiOpen).