Downloads · 30 days
44
7% of all-time downloads
Qwen3.8-27B-MXFP8-GGUF
michaelw9999/Qwen3.8-27B-MXFP8-GGUF
Qwen3.8-27B-MXFP8-GGUF is a machine learning model from michaelw9999. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
More information and benchmarks will be posted soon.<BR This was converted from the original Qwen/Qwen3.8-27B repository.<BR<BR It was quantized using my <A HREF="https://github.com/michaelw9999/advanced-gguf-quantize…
All-time downloads
635
Public
Repo size
28.2 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.gguf28.2 GB · 100%
At a glance
- Access
- Public
- Created
- Aug 16, 2026
- Updated
- Aug 16, 2026
- SHA
- 1de78a59
Base models
Model card
From the Hugging Face model README
More information and benchmarks will be posted soon.<BR> This was converted from the original Qwen/Qwen3.8-27B repository.<BR><BR> It was quantized using my <A HREF="https://github.com/michaelw9999/advanced-gguf-quantizer/">advanced-gguf-quantizer</A> tool.<BR> <BR> To use this model, you must build my unofficial MXFP8 fork of llama.cpp at:<BR> <A HREF="https://github.com/michaelw9999/llama.cpp/tree/mxfp8_cuda">https://github.com/michaelw9999/llama.cpp/tree/mxfp8_cuda</A><BR> On Blackwell, I am seeing that MXFP8 is faster than Q8_0 and is comparable in quality. <BR> I will post some mixed NVFP4/MXFP6/MXFP8 models soon that should provide the fastest possible Blackwell models. <BR> Please let me know your feedback and if you have any problems, I will be happy to help!<BR>
- Created
- Aug 16, 2026
- Updated
- Aug 16, 2026