Downloads · 30 days
24
2% of all-time downloads
rim89987/DeepSeek-R1-0528-Qwen3-8B-abliterated-Q5_0-GGUF
DeepSeek-R1-0528-Qwen3-8B-abliterated-Q5_0-GGUF is a machine learning model from rim89987. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Model name: DeepSeek-R1-0528-Qwen3-8B-abliterated-Q50-GGUF
Downloads · 30 days
24
2% of all-time downloads
All-time downloads
1.4K
Public
Repo size
5.7 GB
Likes
1
Public
Click a slice to open those files.
.gguf5.7 GB · 100%
From the Hugging Face model README
Model name: DeepSeek-R1-0528-Qwen3-8B-abliterated-Q5_0-GGUF
Format: GGUF Quantization: Q5_0 Base model: DeepSeek-R1-0528 / Qwen3-8B Converted by: rim89987
📌 Description
This is a GGUF-converted and quantized version of the DeepSeek-R1-0528 Qwen3-8B abliterated model. The model is optimized for local and lightweight inference using llama.cpp and compatible runtimes.
The Q5_0 quantization offers a strong balance between performance, speed, and memory efficiency, making it suitable for systems with limited VRAM or free cloud environments (e.g., Colab, Kaggle).
🚀 Use Cases
General chat & assistant tasks
Reasoning and logical responses
Coding assistance (light to medium)
Local LLM experiments
GGUF-based inference pipelines
⚙️ Compatibility
llama.cpp
llama-cpp-python
Ollama (GGUF support)
Text-generation-webui (llama backend)
💾 System Requirements (Approx.)
RAM / VRAM: ~6–7 GB
Recommended for CPU or low-end GPU setups
🧾 Credits
Original model: DeepSeek / Qwen
GGUF conversion & quantization: rim89987