Downloads · 30 days
4
22% of all-time downloads
Qwen2.5-Godzilla-Coder-51B-autoAWQ
cgg507/Qwen2.5-Godzilla-Coder-51B-autoAWQ
Qwen2.5-Godzilla-Coder-51B-autoAWQ is a machine learning model from cgg507. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Quanted using lmdeploy - autoawq. Going to run benchmarks to see performence.
All-time downloads
18
Public
Parameters
1.6B
28.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors28.7 GB · 99%
Parameter types
How the weights are stored.
I3249.2B · 97%
Base models
Model card
From the Hugging Face model README
Quanted using lmdeploy - auto_awq. Going to run benchmarks to see performence.
Ran it up on 4x A4000 GPUs with 32k context. Got 30 t/s per request.
- Type
- qwen2
- Created
- Jul 3, 2025
- Updated
- Jul 3, 2025