Downloads · 30 days
2.2K
9% of all-time downloads
Gemma-4-E4B-it-NVFP4
Neural-ICE/Gemma-4-E4B-it-NVFP4
Gemma-4-E4B-it-NVFP4 is a text generation model from Neural-ICE. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
NVFP4 quantized version of google/gemma-4-E4B-it for vLLM.
All-time downloads
24.7K
Public
Parameters
6B
10.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors10.2 GB · 100%
Parameter types
How the weights are stored.
BF164B · 64%
Try a prompt
Base models
Model card
From the Hugging Face model README
Gemma-4-E4B-it-NVFP4
NVFP4 quantized version of google/gemma-4-E4B-it for vLLM.
Quantization Profile
- Text backbone:
NVFP4 lm_head: higher precision- Vision tower and vision embeddings: higher precision
- Audio tower and audio embeddings: higher precision
- KV cache:
FP8
Usage
vllm serve Neural-ICE/Gemma-4-E4B-it-NVFP4 \
--quantization modelopt \
--gpu-memory-utilization 0.90
Official Gemma 4 vLLM recipe:
https://docs.vllm.ai/projects/recipes/en/latest/Google/Gemma4.html
Text Generation
curl http://localhost:8000/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "Neural-ICE/Gemma-4-E4B-it-NVFP4",
"messages": [
{"role": "user", "content": "Explain quantum entanglement in simple terms."}
],
"max_tokens": 512
}'
- Task
- Text Generation
- Library
- transformers
- Type
- gemma4
- License
- apache-2.0
- Created
- Apr 8, 2026
- Updated
- Apr 8, 2026