Downloads · 30 days
146
22% of all-time downloads
gemma-4-E2B-it-assistant-gguf
mags0ft/gemma-4-E2B-it-assistant-gguf
gemma-4-E2B-it-assistant-gguf is a any-to-any model from mags0ft. Use it for the any-to-any task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This repository contains the BF16 and Q80 GGUF files for use in stock llama.cpp converted via the default converthftogguf.py script from llama.cpp.
All-time downloads
649
Public
Repo size
268 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf268 MB · 100%
At a glance
- Task
- Any-to-Any
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Jul 17, 2026
- Updated
- Jul 17, 2026
- SHA
- 671190e0
Base models
Model card
From the Hugging Face model README
Gemma 4 E2B MTP GGUFs
This repository contains the BF16 and Q8_0 GGUF files for use in stock llama.cpp converted via the default convert_hf_to_gguf.py script from llama.cpp.
Usage:
./llama-server
# ... all your other command-line arguments
--spec-type draft-mtp
--spec-draft-model ./PATH_TO_ASSISTANT_GGUF
--spec-draft-n-max 2
This is an unofficial repository not endorsed by or connected to Google LLC.
- Task
- Any-to-Any
- Library
- transformers
- License
- apache-2.0
- Created
- Jul 17, 2026
- Updated
- Jul 17, 2026