Downloads · 30 days
0
Subh24ai/yojana-sahayak-qwen2.5-1.5b-qlora
yojana-sahayak-qwen2.5-1.5b-qlora is a machine learning model from Subh24ai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Fine-tuned Qwen/Qwen2.5-1.5B-Instruct on Indian government scheme Q&A in English and Hindi. Part of the Yojana Sahayak project — a multilingual voice assistant for government welfare schemes.
Downloads · 30 days
0
Access
Public
Updated Mar 29, 2026
Repo size
159 MB
Likes
1
Public
Click a slice to open those files.
.safetensors73.9 MB · 82%
From the Hugging Face model README
Fine-tuned Qwen/Qwen2.5-1.5B-Instruct on Indian government scheme Q&A in English and Hindi. Part of the Yojana Sahayak project — a multilingual voice assistant for government welfare schemes.
| Metric | Score |
|---|---|
| Train loss | 0.3375 |
| Eval loss | 0.2073 |
| Perplexity | 1.15 |
| ROUGE-1 | 0.1762 |
| ROUGE-2 | 0.1501 |
| ROUGE-L | 0.1754 |
| Train samples | 10,000 |
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-1.5B-Instruct")
model = PeftModel.from_pretrained(base, "Subh24ai/yojana-sahayak-qwen2.5-1.5b-qlora")
tokenizer = AutoTokenizer.from_pretrained("Subh24ai/yojana-sahayak-qwen2.5-1.5b-qlora")
messages = [
{"role": "system", "content": "You are Yojana Sahayak..."},
{"role": "user", "content": "PM Kisan ke liye kaun eligible hai?"}
]
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(prompt, return_tensors="pt")
output = model.generate(**inputs, max_new_tokens=200)
print(tokenizer.decode(output[0], skip_special_tokens=True))