Downloads · 30 days
345
27% of all-time downloads
muzzy/GLM-5.2-FP8-DFlash-GGUF
GLM-5.2-FP8-DFlash-GGUF is a machine learning model from muzzy. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Update: now getting 15% acceptance rate on ikllama with:
Downloads · 30 days
345
27% of all-time downloads
All-time downloads
1.3K
Public
Repo size
22.4 GB
Likes
0
Public
Click a slice to open those files.
.gguf7.5 GB · 100%
From the Hugging Face model README
Update: now getting 15% acceptance rate on ik_llama with:
--spec-type dflash:n_max=1,p_min=0.0
This was converted with the ik_llama.cpp conversion script.
python3 convert_hf_to_gguf.py --target-model-dir /ai/GLM-5.2-FP8/ /ai/GLM-5.2-FP8-DFlash/ --outtype bf16
Original README:
This is an attempted conversion of https://huggingface.co/UCloud-org/GLM-5.2-FP8-DFlash to gguf format. Both models function in ik_llama, but I cannot get either to get higher than 5% acceptance. I'm not sure which tokenizer to use, I think is the problem.