Downloads · 30 days
26
3% of all-time downloads
DeepSeek-V3.1-Terminus-GGUF
bobchenyx/DeepSeek-V3.1-Terminus-GGUF
DeepSeek-V3.1-Terminus-GGUF is a text generation model from bobchenyx. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Adopting BF16 & Imatrix from unsloth/DeepSeek-V3.1-Terminus-GGUF. (Huge fan of unsloth)
All-time downloads
1K
Public
Repo size
964 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf964 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Access
- Public
- Created
- Sep 30, 2025
- Updated
- Oct 13, 2025
- SHA
- 3cd2d706
Try a prompt
Base models
Model card
From the Hugging Face model README
Llamacpp Quantizations of deepseek-ai/DeepSeek-V3.1-Terminus
Adopting BF16 & Imatrix from unsloth/DeepSeek-V3.1-Terminus-GGUF. (Huge fan of unsloth)
Personalized Replication of Low-Bit Mixed Precision Quant using --tensor-type option in llama.cpp
IQ1_S with more dynamic mix for extreme compression.
- IQ1_S : 137.66 GiB (1.76 BPW)
- IQ1_M : 151.25 GiB (1.94 BPW)
- Q2_K_L : 231.55 GiB (2.96 BPW)
- Q4_K_M : 376.89 GiB (4.82 BPW)
Download Guide
# !pip install huggingface_hub hf_transfer
import os
os.environ["HF_HUB_ENABLE_HF_TRANSFER"] = "1"
from huggingface_hub import snapshot_download
snapshot_download(
repo_id = "bobchenyx/DeepSeek-V3.1-Terminus-GGUF",
local_dir = "bobchenyx/DeepSeek-V3.1-Terminus-GGUF",
allow_patterns = ["*IQ1_M*"], # Q2_K_L,Q4_K_M
)
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Created
- Sep 30, 2025
- Updated
- Oct 13, 2025