Downloads · 30 days
93
12% of all-time downloads
helenk/gemma-4-E2B-finetune-GGUF
gemma-4-E2B-finetune-GGUF is a text generation model from helenk. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as gemma.
Q4KM-quantized GGUF of the OfflineAid Stage-1 fine-tune (E2B variant). Drop-in for llama.cpp and Ollama. Smaller sibling of helenk/gemma-4-E4B-finetune-GGUF — same training corpus and recipe, lower memory footprint.
Downloads · 30 days
93
12% of all-time downloads
All-time downloads
773
Public
Repo size
3.4 GB
Likes
2
Public
Click a slice to open those files.
.gguf3.4 GB · 100%
From the Hugging Face model README
Q4_K_M-quantized GGUF of the OfflineAid Stage-1 fine-tune (E2B variant). Drop-in for llama.cpp and Ollama. Smaller sibling of helenk/gemma-4-E4B-finetune-GGUF — same training corpus and recipe, lower memory footprint.
unsloth/gemma-4-E2B-ithelenk/gemma-4-E2B-lora — Unsloth fine-tune on Kaggle T4helenk/gemma-4-E2B-finetunepeft.merge_and_unload → llama.cpp/convert_hf_to_gguf.py → llama-quantize Q4_K_Mollama pull hf.co/helenk/gemma-4-E2B-finetune-GGUF
Or via a local Modelfile:
FROM /path/to/gemma-4-E2B-offlineaid-Q4_K_M.gguf
RENDERER gemma4
PARSER gemma4
PARAMETER num_ctx 32768
PARAMETER stop "<turn|>"
PARAMETER temperature 0.0
ollama create offlineaid-e2b -f Modelfile
ollama run offlineaid-e2b
./llama-cli \
-m gemma-4-E2B-offlineaid-Q4_K_M.gguf \
-p "Answer in Simplified Chinese.\n\nQUESTION: ..." \
--temp 0.0 -n 256
Tier A held-out numbers for the writeup are reported on the larger E4B variant — see helenk/gemma-4-E4B-finetune-GGUF for the full methodology and the headline result (fine-tune + RAG raises overall multilingual format-OK from 53.2% → 70.3% vs stock + RAG, with AR format-OK +32.4 pp / 2.5×). Both E2B and E4B share identical training data, recipe, and quantization chain.
Lower-memory variant of the OfflineAid Stage-1 fine-tune. Pixel 7 production deployment uses stock Gemma 4 E2B + retrieval, not this fine-tune; see the project writeup for the architectural rationale.
Inherits Google's Gemma Terms of Use. Training data (helenkwok/offlineaid) is CC-BY-4.0.
helenk/gemma-4-E2B-finetunehelenk/gemma-4-E2B-lorahelenk/gemma-4-E4B-finetune-GGUF