Downloads · 30 days
19
11% of all-time downloads
AgileAndy/Qwen3.8-27B-oQ6e
Qwen3.8-27B-oQ6e is a machine learning model from AgileAndy. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx.
Found a BF16, a Q4 and a Q8, but for me Q6 is the sweetspot
Downloads · 30 days
19
11% of all-time downloads
All-time downloads
179
Public
Parameters
27.4B
23.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors23.2 GB · 100%
How the weights are stored.
U3226.9B · 98%
From the Hugging Face model README
Found a BF16, a Q4 and a Q8, but for me Q6 is the sweetspot
This model was quantized using oQ (oMLX v0.5.7) mixed-precision quantization.