Downloads · 30 days
135
1% of all-time downloads
Gemma-4-E2B-it-NVFP4
Neural-ICE/Gemma-4-E2B-it-NVFP4
Gemma-4-E2B-it-NVFP4 is a text generation model from Neural-ICE. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
NVFP4 quantized version of google/gemma-4-E2B-it for vLLM.
All-time downloads
11.7K
Public
Parameters
4.2B
7.6 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors7.5 GB · 100%
Parameter types
How the weights are stored.
BF163.2B · 75%
Try a prompt
Base models
Model card
From the Hugging Face model README
Gemma-4-E2B-it-NVFP4
NVFP4 quantized version of google/gemma-4-E2B-it for vLLM.
Quantization Profile
- Text backbone:
NVFP4 lm_head: higher precision- Vision tower and vision embeddings: higher precision
- Audio tower and audio embeddings: higher precision
- KV cache:
FP8
Usage
vllm serve Neural-ICE/Gemma-4-E2B-it-NVFP4 \
--quantization modelopt \
--gpu-memory-utilization 0.90
Official Gemma 4 vLLM recipe:
https://docs.vllm.ai/projects/recipes/en/latest/Google/Gemma4.html
Text Generation
curl http://localhost:8000/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "Neural-ICE/Gemma-4-E2B-it-NVFP4",
"messages": [
{"role": "user", "content": "Explain quantum entanglement in simple terms."}
],
"max_tokens": 512
}'
- Task
- Text Generation
- Library
- transformers
- Type
- gemma4
- License
- apache-2.0
- Created
- Apr 8, 2026
- Updated
- Apr 8, 2026