Downloads · 30 days
48
6% of all-time downloads
olegshulyakov/DeepSeek-R1-0528-Qwen3-8B-GGUF
DeepSeek-R1-0528-Qwen3-8B-GGUF is a machine learning model from olegshulyakov. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
Model creator: deepseek-ai<br/ Original model: deepseek-ai/DeepSeek-R1-0528-Qwen3-8B<br/ GGUF quantization: provided by olegshulyakov using llama.cpp<br/ 🙏 Special thanks to Georgi Gerganov and the whole team working…
Downloads · 30 days
48
6% of all-time downloads
All-time downloads
828
Public
Repo size
6.8 GB
Likes
1
Public
Click a slice to open those files.
.gguf6.8 GB · 100%
From the Hugging Face model README
Model creator: deepseek-ai<br/>
Original model: deepseek-ai/DeepSeek-R1-0528-Qwen3-8B<br/>
GGUF quantization: provided by olegshulyakov using llama.cpp<br/>
🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.
ollama run "hf.co/olegshulyakov/DeepSeek-R1-0528-Qwen3-8B-GGUF:Q5_K_XL"
lms load "olegshulyakov/DeepSeek-R1-0528-Qwen3-8B-GGUF"
llama-cli -hf olegshulyakov/DeepSeek-R1-0528-Qwen3-8B-GGUF:Q5_K_XL -p "The meaning to life and the universe is"
llama-server -hf olegshulyakov/DeepSeek-R1-0528-Qwen3-8B-GGUF:Q5_K_XL -ngl 99 -c 0