Downloads · 30 days
15
8% of all-time downloads
zimengxiong/WeDLM-8B-Instruct-MLX
WeDLM-8B-Instruct-MLX is a text generation model from zimengxiong. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
This is a full-precision (fp16) MLX version of tencent/WeDLM-8B-Instruct for inference on Apple Silicon.
Downloads · 30 days
15
8% of all-time downloads
All-time downloads
182
Public
Parameters
8.2B
16.4 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors16.4 GB · 100%
From the Hugging Face model README
This is a full-precision (fp16) MLX version of tencent/WeDLM-8B-Instruct for inference on Apple Silicon.
It currently does not work too well or provide meaningfull speedup due to lack of pre compilation. https://github.com/ZimengXiong/WeDLM-MLX/tree/main
| Variant | HuggingFace |
|---|---|
| 4-bit | zimengxiong/WeDLM-8B-Instruct-MLX-4bit |
| 8-bit | zimengxiong/WeDLM-8B-Instruct-MLX-8bit |
| fp16 (this model) | zimengxiong/WeDLM-8B-Instruct-MLX |
This model inherits the license from the base model tencent/WeDLM-8B-Instruct.