Downloads · 30 days
13
41% of all-time downloads
OpenR1-Qwen-7B-AWQ-4bits-GEMM
MPWARE/OpenR1-Qwen-7B-AWQ-4bits-GEMM
OpenR1-Qwen-7B-AWQ-4bits-GEMM is a machine learning model from MPWARE. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
AWQ 4bits version of open-r1/OpenR1-Qwen-7B
All-time downloads
32
Public
Parameters
7.6B
5.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.6 GB · 100%
Parameter types
How the weights are stored.
I326.5B · 86%
Base models
Model card
From the Hugging Face model README
AWQ 4bits version of open-r1/OpenR1-Qwen-7B
from awq import AutoAWQForCausalLM
from transformers import AutoTokenizer
model_name = "open-r1/OpenR1-Qwen-7B"
model = AutoAWQForCausalLM.from_pretrained(model_name)
tokenizer = AutoTokenizer.from_pretrained(model_name)
quant_config = { "zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }
model.quantize(tokenizer, quant_config=quant_config)
- Type
- qwen2
- License
- apache-2.0
- Created
- Feb 12, 2025
- Updated
- Feb 12, 2025