Downloads · 30 days
7
10% of all-time downloads
qwen25-7b-awq-offline
rockerritesh/qwen25-7b-awq-offline
qwen25-7b-awq-offline is a machine learning model from rockerritesh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
AWQ 4-bit weights of Qwen2.5-7B-Instruct with a self-contained script.py that runs fully offline (loads from .). Fits a 16 GB GPU.
All-time downloads
72
Public
Parameters
7.6B
5.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.6 GB · 100%
Parameter types
How the weights are stored.
I326.5B · 86%
Model card
From the Hugging Face model README
Qwen2.5-7B-Instruct-AWQ — offline inference bundle
AWQ 4-bit weights of Qwen2.5-7B-Instruct with a self-contained script.py that runs fully offline (loads from .). Fits a 16 GB GPU.
- Type
- qwen2
- License
- apache-2.0
- Created
- Jul 18, 2026
- Updated
- Jul 18, 2026