Downloads · 30 days
9
2% of all-time downloads
bobchenyx/DeepSeek-V3-0324-508B-A32B-MLA-GGUF
DeepSeek-V3-0324-508B-A32B-MLA-GGUF is a text generation model from bobchenyx. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This page is going to be deprecated. For other quantized versions, please refer to moxin-org/DeepSeek-V3-0324-Moxin-GGUF for more details.
Downloads · 30 days
9
2% of all-time downloads
All-time downloads
434
Public
Repo size
109 GB
Likes
0
Public
Click a slice to open those files.
.gguf109 GB · 100%
From the Hugging Face model README
This page is going to be deprecated. For other quantized versions, please refer to moxin-org/DeepSeek-V3-0324-Moxin-GGUF for more details.
All quants made based on moxin-org/CC-MoE.
IQ1_S : 103GB (V1)
For V2 Please visit DeepSeek-V3-0324-Moxin-GGUF/V3-Mini-Exp
# !pip install huggingface_hub hf_transfer
import os
os.environ["HF_HUB_ENABLE_HF_TRANSFER"] = "1"
from huggingface_hub import snapshot_download
snapshot_download(
repo_id = "bobchenyx/DeepSeek-V3-0324-508B-A32B-MLA-GGUF",
local_dir = "bobchenyx/DeepSeek-V3-0324-508B-A32B-MLA-GGUF",
allow_patterns = ["*IQ1_S*"],
)