Downloads · 30 days
54
44% of all-time downloads
gallantpigeon/DeepSeek-V3.2-Speciale-GGUF-preview
DeepSeek-V3.2-Speciale-GGUF-preview is a machine learning model from gallantpigeon. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GGUF quants for ikllama.cpp (llama.cpp fork): https://github.com/ikawrakow/ikllama.cpp/tree/main
Downloads · 30 days
54
44% of all-time downloads
All-time downloads
122
Public
Repo size
1.2 TB
Likes
0
Public
Click a slice to open those files.
.gguf-aa40.7 GB · 10%
From the Hugging Face model README
GGUF quants for ik_llama.cpp (llama.cpp fork):
https://github.com/ikawrakow/ik_llama.cpp/tree/main
Experiment created by stripping out the deepseek DeepseekV32 lightening indexer and treating it as DeepseekV3 arch.
Initial tests suggests minimal performance loss.
Note: Tool calling somewhat broken as support for the new tool call format is not provided here.
No immediate plans to provide preview quants for mainline llama.cpp given current limitations / incoming DeepseekV32 compatibility.
Optimized quants are provided based loosely on my own experiments, and work done by ubergam
Note - weights are file shared and will need to be concatenated:
huggingface-cli download --local-dir DeepSeek-V3.2-Speciale-GGUF-preview --include "q4_k_m/*" gallantpigeon/DeepSeek-V3.2-Speciale-GGUF-preview
cat q4_k_m/* >> deepseek-v3.2-speciale-q4_k_m.gguf