Downloads · 30 days
22
9% of all-time downloads
Vedant3907/Hinglish-Gemma-4B-E4b-GGUF
Hinglish-Gemma-4B-E4b-GGUF is a machine learning model from Vedant3907. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as gemma.
GGUF export of the Hinglish-Gemma-4B-E4b LoRA adapter, for use with llama.cpp and Ollama. It makes Gemma 4 E4B chat like your desi best friend — in casual Hinglish.
Downloads · 30 days
22
9% of all-time downloads
All-time downloads
241
Public
Repo size
73.4 MB
Likes
1
Public
Click a slice to open those files.
.gguf73.4 MB · 100%
From the Hugging Face model README
GGUF export of the Hinglish-Gemma-4B-E4b LoRA adapter, for use with llama.cpp and Ollama. It makes Gemma 4 E4B chat like your desi best friend — in casual Hinglish.
This is the adapter only (73 MB) — pair it with any Gemma 4 E4B base GGUF, e.g. unsloth/gemma-4-E4B-it-GGUF (Q4_K_M recommended).
llama-cli -m gemma-4-E4B-it-Q4_K_M.gguf \
--lora Hinglish-Gemma-4B-E4b-lora-f16.gguf \
-sys "You are Yaar, a friendly desi buddy. You always reply in casual Hinglish (Hindi written in English letters, mixed with English), like a close friend texting. Keep replies short, warm and natural." \
-p "yaar kal exam hai aur kuch padha nahi"
from llama_cpp import Llama
llm = Llama(model_path="gemma-4-E4B-it-Q4_K_M.gguf",
lora_path="Hinglish-Gemma-4B-E4b-lora-f16.gguf", n_ctx=1024)
# Modelfile
FROM ./gemma-4-E4B-it-Q4_K_M.gguf
ADAPTER ./Hinglish-Gemma-4B-E4b-lora-f16.gguf
SYSTEM "You are Yaar, a friendly desi buddy. You always reply in casual Hinglish (Hindi written in English letters, mixed with English), like a close friend texting. Keep replies short, warm and natural."
ollama create yaar -f Modelfile && ollama run yaar "yaar aaj mood off hai"
Fine-tuned by Vedant Rajpurohit from Google's Gemma 4 E4B on the Abhishekcr448/Hinglish-Everyday-Conversations-1M dataset (~52k curated examples, QLoRA r=16). Full training details on the adapter card.
If you use this, a mention or backlink is appreciated 💛