Downloads · 30 days
22
1% of all-time downloads
Qwen3-4B-Instruct-2507-NVFP4
kaitchup/Qwen3-4B-Instruct-2507-NVFP4
Qwen3-4B-Instruct-2507-NVFP4 is a machine learning model from kaitchup. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is Qwen/Qwen3-4B-Instruct-2507 quantized with LLM Compressor with NVFP4. The model has been created, tested, and evaluated by The Kaitchup. The model is compatible with vLLM v0.11. Tested with an RTX 5090.
All-time downloads
1.8K
Public
Parameters
2.8B
3.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.6 GB · 100%
Parameter types
How the weights are stored.
U81.8B · 64%
Base models
Model card
From the Hugging Face model README
This is Qwen/Qwen3-4B-Instruct-2507 quantized with LLM Compressor with NVFP4. The model has been created, tested, and evaluated by The Kaitchup. The model is compatible with vLLM v0.11. Tested with an RTX 5090.
- Developed by: The Kaitchup
- License: Apache 2.0 license
How to Support My Work
Subscribe to The Kaitchup. This helps me a lot to continue quantizing and evaluating models for free. Or if you prefer to give some GPU hours, "buy me a kofi"
- Type
- qwen3
- License
- apache-2.0
- Created
- Nov 13, 2025
- Updated
- Dec 25, 2025