Skip to content

HangGuo

QWen2.5-3B-FlatQuant-OBR-GPTQ-W4A8KV16S50

HangGuo/QWen2.5-3B-FlatQuant-OBR-GPTQ-W4A8KV16S50

QWen2.5-3B-FlatQuant-OBR-GPTQ-W4A8KV16S50 is a text generation model from HangGuo. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.

This repository contains a compressed version of the Qwen2.5-3B-Instruct model, applying the Optimal Brain Restoration (OBR) framework as presented in the paper Optimal Brain Restoration for Joint Quantization and Spa…

Downloads · 30 days

78

42% of all-time downloads

All-time downloads

184

Public

Repo size

12.4 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin6.2 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
mit
Model type
qwen2
Access
Public
Created
Sep 4, 2025
Updated
Sep 26, 2025
SHA
32a6e7d9

Try a prompt

Task
Text Generation
Library
transformers
Type
qwen2
License
mit
Created
Sep 4, 2025
Updated
Sep 26, 2025