Skip to content

MikeKuykendall

deepseek-moe-16b-q4-k-m-cpu-offload-gguf

MikeKuykendall/deepseek-moe-16b-q4-k-m-cpu-offload-gguf

deepseek-moe-16b-q4-k-m-cpu-offload-gguf is a text generation model from MikeKuykendall. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.

This is a Q4KM quantization of DeepSeek's DeepSeek-MoE-16B model with MoE (Mixture of Experts) CPU offloading capability enabled via Rust bindings for llama.cpp.

Downloads · 30 days

82

5% of all-time downloads

All-time downloads

1.7K

Public

Repo size

10.9 GB

Likes

4

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf10.9 GB · 100%

At a glance

Task
Text Generation
License
apache-2.0
Access
Public
Created
Oct 9, 2025
Updated
Oct 9, 2025
SHA
31703112

Try a prompt

Base models

Task
Text Generation
License
apache-2.0
Languages
en, zh
Created
Oct 9, 2025
Updated
Oct 9, 2025