Qwen3-4B-Hindi-Instruct-v2

A Hindi instruction-tuned version of Qwen3-4B, fine-tuned to follow instructions and respond naturally in Hindi. Built for developers, researchers, and builders who need a capable, openly-licensed Hindi language model that runs on modest hardware.

Part of the Hindi LLM Series — a collection focused on bringing strong Indic-language models to local and edge deployment.

💡 Looking to run this locally on CPU? Use the GGUF version (Q4/Q5/Q8) with llama.cpp, Ollama, or LM Studio.

Highlights

• Strong Hindi instruction-following — trained on 10K curated Hindi instruction–response pairs
• Bilingual — handles both Hindi (Devanagari) and English
• Compact — 4B parameters, runs comfortably on a single consumer GPU; quantizes well for CPU
• Open license — Apache 2.0, commercial use allowed

Quick Start

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "pankajpandey-dev/Qwen3-4B-Hindi-Instruct-v2"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, dtype="auto", device_map="auto")

messages = [{"role": "user", "content": "मुझे स्वस्थ रहने के तीन आसान तरीके बताओ।"}]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt").to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256, temperature=0.7)
print(tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))

Model Details

Training

Fine-tuned with Unsloth for efficient LoRA training. The dataset was filtered to keep only genuinely Hindi (Devanagari) responses, then formatted with the Qwen chat template and trained for one full epoch. The resulting LoRA was merged into 16-bit weights and exported.

Intended Use & Limitations

Intended for: Hindi chat and assistant applications, instruction-following, Indic-language experimentation, and local/edge deployment via GGUF.

Limitations: As a 4B model, it can make factual errors and may produce inconsistent results on complex reasoning or specialized domains. It inherits any biases present in the base model and training data. Validate outputs before production use.

Citation

If you use this model, a link back to this repository is appreciated.

---

Part of the 🇮🇳 Hindi LLM Series by pankajpandey-dev.