Downloads · 30 days
0
marathi-qwen2.5-lora
DragonLegend/marathi-qwen2.5-lora
marathi-qwen2.5-lora is a machine learning model from DragonLegend. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
A QLoRA adapter fine-tuned on a Marathi Alpaca instruction dataset to improve Marathi language generation in Qwen2.5-1.5B-Instruct.
Access
Public
Updated Apr 4, 2026
Repo size
85.3 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors73.9 MB · 87%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 4, 2026
- Updated
- Apr 4, 2026
- SHA
- 775e4f6a
Base models
Model card
From the Hugging Face model README
Marathi QLoRA Fine-Tune — Qwen2.5-1.5B-Instruct
A QLoRA adapter fine-tuned on a Marathi Alpaca instruction dataset to improve Marathi language generation in Qwen2.5-1.5B-Instruct.
Training Details
- Base model: unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit
- Dataset: rachittshah/alpaca-marahti (34,499 samples after filtering)
- Method: QLoRA (r=16, alpha=32) via Unsloth
- Hardware: NVIDIA RTX 3050 Ti Laptop GPU (4 GB VRAM)
- Epochs: 1 | Steps: 4,097
- Final validation loss: 0.4479
Evaluation (chrF++)
Corpus chrF++ improved from 15.39 (base) → 25.83 (fine-tuned) (+10.44 points) across 10 Marathi prompts.
Usage
from peft import PeftModel
from unsloth import FastLanguageModel
import torch
model, tokenizer = FastLanguageModel.from_pretrained(
model_name="unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit",
max_seq_length=512,
dtype=torch.float16,
load_in_4bit=True,
)
model = PeftModel.from_pretrained(model, "DragonLegend/marathi-qwen2.5-lora")
GitHub
- License
- apache-2.0
- Languages
- mr, en
- Created
- Apr 4, 2026
- Updated
- Apr 4, 2026