Downloads · 30 days
234
13% of all-time downloads
Gemma-4-E2B-it-MNN
darkmaniac7/Gemma-4-E2B-it-MNN
Gemma-4-E2B-it-MNN is a any-to-any model from darkmaniac7. Use it for the any-to-any task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Published by TokForge for on-device inference.
All-time downloads
1.8K
Public
Repo size
15.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.weight2.3 GB · 60%
At a glance
- Task
- Any-to-Any
- License
- apache-2.0
- Access
- Public
- Created
- Apr 11, 2026
- Updated
- Oct 12, 2026
- SHA
- 0e9da653
Base models
Model card
From the Hugging Face model README
Published by TokForge for on-device inference.
TokForge
- Website: https://tokforge.ai
- Discord: https://discord.gg/Acv3CBtfVm
- Google Play: https://play.google.com/store/apps/details?id=dev.tokforge
- iOS TestFlight: https://testflight.apple.com/join/jnufjzRr
Runs on-device in the TokForge app.
gemma-4-E2B-it-MNN
Introduction
This model is a 4-bit quantized version of the MNN model exported from gemma-4-E2B-it using llmexport.
Usage
# clone MNN source
git clone https://github.com/alibaba/MNN.git
# compile
cd MNN
mkdir build && cd build
cmake .. -DMNN_LOW_MEMORY=true -DMNN_CPU_WEIGHT_DEQUANT_GEMM=true -DMNN_BUILD_LLM=true -DMNN_SUPPORT_TRANSFORMER_FUSE=true
make -j
# run
./llm_demo /path/to/gemma-4-E2B-it-MNN/config.json prompt.txt
Document
Credits
- Gemma 4 E2B IT by Google (Hugging Face). Used under the Apache-2.0 license.
- The MNN conversion (10 of the files here are byte-identical to it) by the taobao-mnn team (Hugging Face). Used under the Apache-2.0 license.
- Converted with llmexport from MNN by Alibaba (Apache-2.0).
- Task
- Any-to-Any
- License
- apache-2.0
- Languages
- en
- Created
- Apr 11, 2026
- Updated
- Oct 12, 2026