Downloads · 30 days
13
8% of all-time downloads
JDhruv14/Qwen2.5-3B-Gita-FT
Qwen2.5-3B-Gita-FT is a text generation model from JDhruv14. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
13
8% of all-time downloads
All-time downloads
171
Public
Parameters
3.1B
6.2 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors6.2 GB · 100%
From the Hugging Face model README
A Bhagavad Gita–focused assistant that adopts a Krishna-inspired teaching persona for guiding in your spiritual path.
</div>Qwen2.5-3B-Gita-FT is a LoRA-tuned model built on Qwen/Qwen2.5-3B-Instruct, focused on tasks around the Bhagavad Gītā. It supports:
Important: The model is not Krishna, nor a religious authority. It patterns its style from training data and prompts. It can make mistakes, simplify nuanced ideas, misremember verse numbers, or produce non-canonical wording. For study or citation, please verify with authoritative editions and scholars.
| Parameter | Value |
|---|---|
| Base Model | Qwen/Qwen2.5-3B-Instruct |
| Fine-tuning | LoRA (rank=16, alpha=32) |
| Seq Length | 1024 (recommend ≥ 512 for long verses) |
| Epochs | 3 |
| LR | 2e-4 |
| Batch | 2 (micro) × 4 (grad acc) |
| Optimizer | AdamW 8-bit |
| Precision | bf16 (training & inference where available) |
Requires
transformers>=4.41,torch,accelerate. Some Qwen models needtrust_remote_code=True.
from transformers import AutoTokenizer, AutoModelForCausalLM
model_name = "JDhruv14/Qwen2.5-3B-Gita-FT"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)
# Prepare the conversation
messages = [
{
"role": "system",
"content": "You are Lord Krishna—the serene, compassionate teacher of the Bhagavad Gita."
},
{
"role": "user",
"content": "Hey Keshav, what's my dharma?"
}
]
# Apply chat template and generate
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=256, temperature=0.7)
response = tokenizer.decode(outputs[0][len(inputs.input_ids[0]):], skip_special_tokens=True)
@misc{gita-qwen-assistant,
title={Gita-qwen-3B-Assistan: A Bhagavad Gītā-focused model for motivating you, guiding you based on the eternal guidance of Madhav.},
author={JDhruv14},
year={2025},
url={https://huggingface.co/JDhruv14/Qwen2.5-3B-Gita-FT}
}
Released under Apache 2.0. See LICENSE.