Downloads · 30 days
14
9% of all-time downloads
yapwithai/bgg1996-melinoe-30B-A3B-thinking-w4a16
bgg1996-melinoe-30B-A3B-thinking-w4a16 is a text generation model from yapwithai. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This model was quantized with LLM Compressor from bgg1996/Melinoe-30B-A3B-Thinking.
Downloads · 30 days
14
9% of all-time downloads
All-time downloads
164
Public
Parameters
4.6B
16.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.7 GB · 100%
How the weights are stored.
I3229.9B · 97%
From the Hugging Face model README
This model was quantized with LLM Compressor from bgg1996/Melinoe-30B-A3B-Thinking.
{
"scheme": "W4A16",
"zero_point": true,
"q_group_size": 128,
"w_bit": 4,
"version": "GEMM",
"targets": "Linear",
"ignore": [
"lm_head"
],
"backend": "llmcompressor"
}
This quantized model inherits the license from the original base model: apache-2.0
See the original model's license for full terms.