Downloads · 30 days
60
7% of all-time downloads
pdelobelle/DeepSeek-R1-GGUF-MTP
DeepSeek-R1-GGUF-MTP is a machine learning model from pdelobelle. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Quantized MTP head of Deepseek R1. For use with the Unsloth's Q4K quants.
Downloads · 30 days
60
7% of all-time downloads
All-time downloads
818
Public
Repo size
8 GB
Likes
2
Public
Click a slice to open those files.
.gguf8 GB · 100%
From the Hugging Face model README
Quantized MTP head of Deepseek R1. For use with the Unsloth's Q4_K quants.
Llama.cpp does not support MTP heads, but vLLM does.