Downloads · 30 days
15
6% of all-time downloads
Phi-4-mini-instruct-w4a4-fp4
pebeto/Phi-4-mini-instruct-w4a4-fp4
Phi-4-mini-instruct-w4a4-fp4 is a text generation model from pebeto. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is a quantized version of the Phi-4-mini-instruct model by Microsoft, quantized using NVFP4 format with 4-bit weights and 4-bit activations.
All-time downloads
269
Public
Parameters
3B
4.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.3 GB · 99%
Parameter types
How the weights are stored.
U81.6B · 53%
Base models
Model card
From the Hugging Face model README
Phi-4-mini-instruct-w4a4-fp4
This is a quantized version of the Phi-4-mini-instruct model by Microsoft, quantized using NVFP4 format with 4-bit weights and 4-bit activations.
Model Description
Phi-4-mini-instruct is a smaller variant of the Phi-4 model, designed for instruction-following tasks. The quantized version retains much of the original model's capabilities while significantly reducing its size and computational requirements.
Quantization Details
- Quantization Format: NVFP4
- Weight Precision: 4-bit
- Activation Precision: 4-bit
- Quantization Tool: LLM Compressor
- Task
- Text Generation
- Library
- transformers
- Type
- phi3
- License
- mit
- Languages
- multilingual, ar, zh, cs, da, nl
- Created
- Dec 17, 2025
- Updated
- Dec 17, 2025