Downloads · 30 days
51
3% of all-time downloads
coder423/mamba-370m-hf-turkish-GGUF
mamba-370m-hf-turkish-GGUF is a text generation model from coder423. Use it when you need the model to write or continue text. It is set up for gguf.
GGUF quantized versions of serda-dev/mamba-370m-hf-turkish.
Downloads · 30 days
51
3% of all-time downloads
All-time downloads
1.5K
Public
Repo size
2.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf2.3 GB · 100%
From the Hugging Face model README
GGUF quantized versions of serda-dev/mamba-370m-hf-turkish.
| File | Quant Type | Size |
|---|---|---|
| mamba-370m-hf-turkish-f16.gguf | F16 | 714.7 MB |
| mamba-370m-hf-turkish-q2-k.gguf | Q2_K | 151.6 MB |
| mamba-370m-hf-turkish-q3-k-m.gguf | Q3_K_M | 181.8 MB |
| mamba-370m-hf-turkish-q4-k-m.gguf | Q4_K_M | 222.0 MB |
| mamba-370m-hf-turkish-q5-k-m.gguf | Q5_K_M | 259.5 MB |
| mamba-370m-hf-turkish-q6-k.gguf | Q6_K | 300.8 MB |
| mamba-370m-hf-turkish-q8-0.gguf | Q8_0 | 384.6 MB |
These GGUF files can be used with llama.cpp and compatible tools that support Mamba architecture.
./llama-cli -m mamba-370m-hf-turkish-q4-k-m.gguf -p "Turkiye'nin baskenti" -n 128
llama.cpp convert_hf_to_gguf.py