michaellin

Qwen2.5-Coder-7B-4bit-mlx-dwq-lr1e-7

michaellin/Qwen2.5-Coder-7B-4bit-mlx-dwq-lr1e-7

Qwen2.5-Coder-7B-4bit-mlx-dwq-lr1e-7 is a text generation model from michaellin. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.

This model was generated using DWQ quantization to bring the quality of the 4bit quantization closer to 8bit without increasing in size. This was done using mlx-lm version 0.26.3, using --bits 4 --learning-rate 1e-7 -…