Downloads · 30 days
13
13% of all-time downloads
Bhaveshbhau44/Llama-3.2-3B-Gita-Vedic-Finetuned
Llama-3.2-3B-Gita-Vedic-Finetuned is a text generation model from Bhaveshbhau44. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a fully merged and quantization-ready version of Llama 3.2 3B fine-tuned on the Bhagavad Gita corpus for understanding Vedic philosophy and [translate:Dharma].
Downloads · 30 days
13
13% of all-time downloads
All-time downloads
97
Public
Parameters
3.2B
6.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.4 GB · 100%
From the Hugging Face model README
This is a fully merged and quantization-ready version of Llama 3.2 3B fine-tuned on the Bhagavad Gita corpus for understanding Vedic philosophy and [translate:Dharma].
LoRA Configuration:
Rank (r): 16
Alpha: 32
Target Modules: q_proj, k_proj, v_proj, o_proj
Dropout: 0.05
Learning Rate: 1e-4
Batch Size: 4
Optimizer: AdamW
Max Length: 512 tokens
text
Hardware: Google Cloud TPU v6e-8
8 TPU cores running in parallel
Distributed training across all cores
BF16 precision for efficiency
Compute Resources:
Training Duration: ~20 minutes
Samples per core: ~88-90
Total batches: ~22
text
This model excels at:
✅ Understanding [translate:Dharma] - Discussing duty, righteousness, and cosmic law
✅ Karma Yoga concepts - Explaining action without attachment
✅ Philosophical discussions - Deep understanding of ancient wisdom
✅ Sanskrit references - Recognizing and explaining Sanskrit terms
✅ Vedic knowledge - Providing context from Vedic literature
✅ Meditation & spirituality - Guidance on inner peace and enlightenment
pip install transformers torch
text
import torch from transformers import AutoModelForCausalLM, AutoTokenizer Load model and tokenizer
model = AutoModelForCausalLM.from_pretrained( "Bhaveshbhau44/Llama-3.2-3B-Gita-Vedic-Finetuned", torch_dtype=torch.float16, device_map="auto" )
tokenizer = AutoTokenizer.from_pretrained( "Bhaveshbhau44/Llama-3.2-3B-Gita-Vedic-Finetuned" ) Generate text
prompt = "What is the meaning of Karma Yoga?" inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
with torch.no_grad(): outputs = model.generate( **inputs, max_new_tokens=150, temperature=0.7, top_p=0.9, do_sample=True )
response = tokenizer.decode(outputs, skip_special_tokens=True) print(response)
text
A: The purpose of life according to the Gita is to attain Moksha or Liberation. Moksha is the state of ultimate bliss and freedom from the cycle of birth and death. The Bhagavad Gita teaches that one can attain Moksha by performing one's duty without attachment and expectation of reward. This is achieved through the practice of Karma Yoga - the path of action...
A: Krishna teaches that duty ([translate:Dharma]) is the foundation of righteous living. One should perform their duties according to their nature and station in life without being attached to the fruits of their actions. The Gita emphasizes that it is better to perform one's own duty imperfectly than to perform another's duty perfectly...
A: According to the Bhagavad Gita, inner peace is achieved through the practice of yoga and meditation. The mind must be trained to focus inward, away from the distractions and pleasures of the world. Through consistent practice and devotion, one can quiet the mind and experience the peace that comes from direct realization of the Divine...
This model is ideal for:
If you use this model, please cite:
@misc{bhavesh_llama_gita_2025, title={Llama 3.2 3B - Bhagavad Gita Fine-tuned}, author={Bhavesh Varma}, year={2025}, publisher={HuggingFace Hub}, url={https://huggingface.co/Bhaveshbhau44/Llama-3.2-3B-Gita-Vedic-Finetuned} }
text
Last Updated: November 4, 2025
Model Status: ✅ Active & Ready to Use