Downloads · 30 days
11
3% of all-time downloads
Qwen2.5-1.5B-Instruct-w4a4-fp4
pebeto/Qwen2.5-1.5B-Instruct-w4a4-fp4
Qwen2.5-1.5B-Instruct-w4a4-fp4 is a text generation model from pebeto. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a quantized version of the Qwen2.5-1.5B-Instruct model by Qwen, quantized using NVFP4 format with 4-bit weights and 4-bit activations.
All-time downloads
420
Public
Parameters
1.2B
1.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.7 GB · 99%
Parameter types
How the weights are stored.
U8655M · 54%
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen2.5-1.5B-Instruct-w4a4-fp4
This is a quantized version of the Qwen2.5-1.5B-Instruct model by Qwen, quantized using NVFP4 format with 4-bit weights and 4-bit activations.
Model Description
Qwen2.5-1.5B-Instruct is a variant of the Qwen model, designed for instruction-following tasks. The quantized version retains much of the original model's capabilities while significantly reducing its size and computational requirements.
Quantization Details
- Quantization Format: NVFP4
- Weight Precision: 4-bit
- Activation Precision: 4-bit
- Quantization Tool: LLM Compressor
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Dec 17, 2025
- Updated
- Dec 17, 2025