Downloads · 30 days
27
5% of all-time downloads
DeepSeek-V3-0324-IQ2_KS
gghfez/DeepSeek-V3-0324-IQ2_KS
DeepSeek-V3-0324-IQ2_KS is a text generation model from gghfez. Use it when you need the model to write or continue text. The card lists the license as mit.
This is an IQ2KS quant of DeepSeek-V3-0324 using ubergarm's IQ2KS recipe from ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF and Imatrix file from ubergarm/DeepSeek-V3-0324-GGUF.
All-time downloads
588
Public
Repo size
219 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf219 GB · 100%
At a glance
- Task
- Text Generation
- License
- mit
- Access
- Public
- Created
- Jul 29, 2025
- Updated
- Oct 18, 2025
- SHA
- 529606c2
Try a prompt
Base models
Model card
From the Hugging Face model README
ik_llama.cpp imatrix MLA Quantizations of DeepSeek-V3-0324
This is an IQ2_KS quant of DeepSeek-V3-0324 using ubergarm's IQ2_KS recipe from ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF and Imatrix file from ubergarm/DeepSeek-V3-0324-GGUF.
This quant collection REQUIRES ik_llama.cpp fork to support advanced non-linear SotA quants and Multi-Head Latent Attention (MLA). Do not download these big files and expect them to run on mainline vanilla llama.cpp, ollama, LM Studio, KoboldCpp, etc!
See ubergarm/DeepSeek-V3-0324-GGUF for his other quants and more details about them.
I've uploaded the converted BF16 weights gghfez/DeepSeek-V3-0324-256x21B-BF16 if I, or anyone else wants to create similar quants in the future.
TODO: fix links, etc in the model card.
- Task
- Text Generation
- License
- mit
- Created
- Jul 29, 2025
- Updated
- Oct 18, 2025