Downloads · 30 days
5
10% of all-time downloads
gemma-4-e4b-hindi-instruct-lora
pankajpandey-dev/gemma-4-e4b-hindi-instruct-lora
gemma-4-e4b-hindi-instruct-lora is a machine learning model from pankajpandey-dev. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as gemma.
LoRA adapter (r=16) for Hindi instruction-tuning of Gemma 4 E4B. Apply on top of the base model, or use the ready-made merged / GGUF builds.
All-time downloads
49
Public
Repo size
179 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors147 MB · 82%
At a glance
- Library
- peft
- License
- gemma
- Access
- Public
- Created
- Jun 27, 2026
- Updated
- Jun 27, 2026
- SHA
- 94077c43
Base models
Model card
From the Hugging Face model README
🇮🇳 Gemma-4-E4B-Hindi-Instruct — LoRA adapter
LoRA adapter (r=16) for Hindi instruction-tuning of Gemma 4 E4B. Apply on top of the base model, or use the ready-made merged / GGUF builds.
Part of my Hindi LLM Series.
Usage (PEFT)
from transformers import AutoModelForCausalLM
from peft import PeftModel
base = AutoModelForCausalLM.from_pretrained("unsloth/gemma-4-E4B-it", device_map="auto")
model = PeftModel.from_pretrained(base, "pankajpandey-dev/gemma-4-e4b-hindi-instruct-lora")
Or with Unsloth:
from unsloth import FastModel
model, tok = FastModel.from_pretrained("pankajpandey-dev/gemma-4-e4b-hindi-instruct-lora")
Training details
| Base model | unsloth/gemma-4-E4B-it |
| Method | LoRA (r=16, α=16), response-only loss |
| Framework | Unsloth |
| Data | ~10k Hindi instruction pairs (AI4Bharat indic-instruct: anudesh + dolly, hi splits) |
| Epochs | 2 |
| LR / schedule | 1e-4, cosine |
| Precision | bf16 (4-bit QLoRA base) |
| Hardware | Single NVIDIA L4 (24 GB) |
| Final train loss | ~0.29 |
Related repos
- 16-bit model:
pankajpandey-dev/gemma-4-e4b-hindi-instruct - GGUF (Q4/Q5/Q8):
pankajpandey-dev/gemma-4-e4b-hindi-instruct-GGUF
Provenance & license (please read)
Mixed-license lineage — review all before redistribution or commercial use:
- Adapter trained on Gemma 4 (Gemma Terms of Use).
- Data from AI4Bharat indic-instruct-data-v0.1: Dolly (CC-BY-SA-3.0) + Anudesh (responses from Llama-2-70B, Llama 2 Community License).
You are responsible for complying with the Gemma, Llama 2, and CC-BY-SA terms.
Acknowledgements
Base model by Google (Gemma 4). Data by AI4Bharat. Fine-tuning with Unsloth. 🙏
- Library
- peft
- License
- gemma
- Languages
- hi, en
- Created
- Jun 27, 2026
- Updated
- Jun 27, 2026