Downloads · 30 days
21
6% of all-time downloads
chenhunghan/TAIDE-LX-7B-Chat-mlx-4bit
TAIDE-LX-7B-Chat-mlx-4bit is a machine learning model from chenhunghan. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as other.
Downloads · 30 days
21
6% of all-time downloads
All-time downloads
375
Public
Parameters
6.9B
4.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors4.2 GB · 100%
How the weights are stored.
U326.7B · 97%
From the Hugging Face model README
pip install -U mlx-lm
python -m mlx_lm.generate --model chenhunghan/TAIDE-LX-7B-Chat-mlx-4bit --prompt 'TAIDE可以吃嗎?'
python -m mlx_lm.convert --hf-path taide/TAIDE-LX-7B-Chat -q