Downloads · 30 days
16
41% of all-time downloads
tachyphylaxis/DeepSeek-R1-0528-IK_GGUF
DeepSeek-R1-0528-IK_GGUF is a machine learning model from tachyphylaxis. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Quantized using ikllama.cpp build = 3788 (4622fadc)
Downloads · 30 days
16
41% of all-time downloads
All-time downloads
39
Public
Repo size
442 GB
Likes
0
Public
Click a slice to open those files.
.gguf346 GB · 100%
From the Hugging Face model README
ik_llama.cpp quantizations of DeepSeek-R1-0528Quantized using ik_llama.cpp build = 3788 (4622fadc)
NOTE: These quants MUST be run using the llama.cpp fork, ik_llama.cpp
Credits to @ubergarm for his DeepSeek quant recipes for which these quants were based on.
| name | file size | quant type | bpw |
|---|---|---|---|
| DeepSeek-R1-0528-IQ4_KT | 322.355 GiB | IQ4_KT (97.5%) / Q8_0 (2.5%) | 4.127 |