Downloads · 30 days
2.8K
56% of all-time downloads
rpatel622/mamba2-130m-hf-Q8_0-GGUF
mamba2-130m-hf-Q8_0-GGUF is a machine learning model from rpatel622. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Quantized GGUF version of benchang1110/mamba2-130m-hf for use with llama.cpp.
Downloads · 30 days
2.8K
56% of all-time downloads
All-time downloads
4.9K
Public
Repo size
361 MB
Likes
0
Public
Click a slice to open those files.
.gguf361 MB · 100%
From the Hugging Face model README
Quantized GGUF version of benchang1110/mamba2-130m-hf for use with llama.cpp.
| Attribute | Value |
|---|---|
| Base model | benchang1110/mamba2-130m-hf |
| Original size | 335 MB (bfloat16 safetensors) |
| Quantized size | 173 MB |
| Format | GGUF V3 |
| Quantization | Q8_0 (50 tensors quantized, 169 kept F32) |
| Architecture | mamba2 |
| Layers | 24 |
| Vocab size | 50,288 |
| Context length | 1,048,576 |
Apache-2.0 (same as base model)