Downloads · 30 days
71
7% of all-time downloads
sokann/DeepSeek-V4-Flash-0731-GGUF
DeepSeek-V4-Flash-0731-GGUF is a machine learning model from sokann. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This is a GGUF model for DeepSeek-V4-Flash, created with the converthftogguf.py script, which does 2 things: Repacks routed experts tensors in FP4 to MXFP4. Quantizes other tensors in FP8 to Q80.
Downloads · 30 days
71
7% of all-time downloads
All-time downloads
1K
Public
Repo size
358 GB
Likes
3
Public
Click a slice to open those files.
.gguf358 GB · 100%
From the Hugging Face model README
This is a GGUF model for DeepSeek-V4-Flash, created with the convert_hf_to_gguf.py script, which does 2 things:
The GGUF model can be considered as lossless when compared to the original weights in safetensors.
It works fine in both ik_llama.cpp and llama.cpp. It is faster with ik_llama.cpp, but support for SWA is still in progress.