Downloads · 30 days
5
3% of all-time downloads
andriadze/anthracite-magnum-v3-34b-awq
anthracite-magnum-v3-34b-awq is a text generation model from andriadze. Use it when you need the model to write or continue text.
This is a AWQ GEMM quant of magnum-v3-34b: https://huggingface.co/anthracite-org/magnum-v3-34b
Downloads · 30 days
5
3% of all-time downloads
All-time downloads
146
Public
Parameters
34.4B
19.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors19.2 GB · 100%
How the weights are stored.
I3233.5B · 97%
From the Hugging Face model README
This is a AWQ GEMM quant of magnum-v3-34b: https://huggingface.co/anthracite-org/magnum-v3-34b
Model has been quantized on 6xRTX4090, here are quantization parameters:
"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM"