CPU-Hybrid-MoE

DeepSeek-V3-0324-CPU-NUMA4-AMXINT4

CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA4-AMXINT4

DeepSeek-V3-0324-CPU-NUMA4-AMXINT4 is a text generation model from CPU-Hybrid-MoE. Use it when you need the model to write or continue text.

For inference with sglang and kt-kernel: https://lmsys.org/blog/2025-10-22-KTransformers/