Downloads · 30 days
0
0% of all-time downloads
gemma-4-E2B-coreml
smdesai/gemma-4-E2B-coreml
gemma-4-E2B-coreml is a image-text-to-text model from smdesai. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Converted from google/gemma-4-E2B-it for on-device inference on Apple devices via CoreML.
All-time downloads
96
Public
Repo size
12.8 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin26.8 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- License
- apache-2.0
- Access
- Public
- Created
- Apr 10, 2026
- Updated
- Apr 10, 2026
- SHA
- 0ab7c8aa
Try a prompt
Base models
Model card
From the Hugging Face model README
Gemma 4 E2B — CoreML (ANE+GPU Optimized)
Converted from google/gemma-4-E2B-it for on-device inference on Apple devices via CoreML.
Models
| File | Size | Description |
|---|---|---|
model.mlpackage | 2.4 GB | Text decoder with stateful KV cache (int4 quantized) |
vision.mlpackage | 322 MB | Vision encoder (SigLIP-based, 16 transformer layers) |
model_config.json | — | Model configuration |
hf_model/tokenizer.json | 31 MB | Tokenizer |
Features
- Multimodal: Image + text input → text output
- ANE-optimized: Conv2d linear layers, ANE RMSNorm, in-model argmax
- Stateful KV cache: MLState API (iOS 18+)
- Int4 quantized: Block-wise palettization (group_size=32)
- HF-exact match: "solid red square centered on white background" ✅
Usage
import coremltools as ct
import numpy as np
# Load models
vision = ct.models.MLModel('vision.mlpackage')
decoder = ct.models.MLModel('model.mlpackage')
state = decoder.make_state()
# Process image → vision features → text generation
See CoreML-LLM for the full conversion pipeline and iOS sample app.
Conversion
git clone https://github.com/john-rocky/CoreML-LLM
cd CoreML-LLM/conversion
pip install -r requirements.txt
python convert.py --model gemma4-e2b --context-length 512 --output ./output/gemma4-e2b
- Task
- Image-Text-to-Text
- License
- apache-2.0
- Created
- Apr 10, 2026
- Updated
- Apr 10, 2026