Downloads · 30 days
0
DrontGPTQ
VDC-team/DrontGPTQ
DrontGPTQ is a machine learning model from VDC-team. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
DrontGPTQ is a simple quantizer for GPT-like models.
Access
Public
Updated Jul 26, 2026
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.py25.8 KB · 92%
At a glance
- License
- mit
- Access
- Public
- Created
- Jul 26, 2026
- Updated
- Jul 26, 2026
- SHA
- 0fc188e4
Model card
From the Hugging Face model README
DrontGPTQ is a simple quantizer for GPT-like models.
Supports:
2 bit ✅
3 bit ✅
4 bit ✅
5 bit ✅
6 bit ✅
7 bit ❌
8 bit ✅
12 bit ✅
16 bit ✅
32 bit ✅
Consists of just two files.
DrontQ.py – a very simple quantizer. Converts HF F32 to .dq format (Dront quant).
DQuse.py – a simple way to run .dq models.
To use this, scroll to the end of the files; you will find the main variables there, which you should adjust to your needs. Quantizes local models—specifically GPT-like ones. Most Dront gpt-like models will also be released in DQ quantization! Especially the new VdrontV
- License
- mit
- Languages
- en
- Created
- Jul 26, 2026
- Updated
- Jul 26, 2026