Downloads · 30 days
57
14% of all-time downloads
moeshawky/DeepSeek-V4-Flash-Q4-mxfp4-0731-abliterated
DeepSeek-V4-Flash-Q4-mxfp4-0731-abliterated is a text generation model from moeshawky. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is a conversion of the DeepSeek-V4-Flash Q4-MXFP4 GGUF from hf://huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF/DeepSeek-V4-Flash-Q4-mxfp4-0731.gguf to native safetensors format, with the DSpark 3-stage…
Downloads · 30 days
57
14% of all-time downloads
All-time downloads
401
Public
Parameters
304B
167 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors167 GB · 100%
How the weights are stored.
I8296B · 97%
From the Hugging Face model README
This is a conversion of the DeepSeek-V4-Flash Q4-MXFP4 GGUF from
hf://huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF/DeepSeek-V4-Flash-Q4-mxfp4-0731.gguf
to native safetensors format, with the DSpark 3-stage speculative drafter head
included on top.
huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF
→ DeepSeek-V4-Flash-Q4-mxfp4-0731.gguf (Q4-MXFP4 quant, abliterated),
converted to safetensors shards.model-00001..00045-of-00048.safetensors
(routed experts as native packed FP4, other quantized matrices as 128x128
E4M3/E8M0 block FP8).model-00046..00048-of-00048.safetensors
(mtp.0 -> 46, mtp.1 -> 47, mtp.2 -> 48), mirroring the official repo's
placement. Routed experts retain source MXFP4 values losslessly; other
matrices use block FP8. The drafter weights are an additional inclusion,
sourced from a separate DeepSeek-V4-Flash-DSpark draft GGUF (see
conversion_manifest.json); they are not part of the huihui-ai GGUF.config.json is the official DSpark config verbatim, laid out to load
exactly like deepseek-ai/DeepSeek-V4-Flash-DSpark.inference/config.json carries the official loader's n_mtp_layers: 3.This is a format conversion of already-quantized weights, not a recovery of the
original FP8 checkpoint. See conversion_manifest.json for provenance.