Downloads · 30 days
17
7% of all-time downloads
mlx-yayi2-30b-guanaco-4-bit
mzbac/mlx-yayi2-30b-guanaco-4-bit
mlx-yayi2-30b-guanaco-4-bit is a machine learning model from mzbac. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as other.
Run it using the MlX framework. For more details, click here.
All-time downloads
241
Public
Repo size
18.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.npz18.1 GB · 100%
At a glance
- Library
- mlx
- License
- other
- Model type
- yayi
- Access
- Public
- Created
- Jan 1, 2024
- Updated
- Jan 1, 2024
- SHA
- 0e1332ad
Model card
From the Hugging Face model README
Run it using the MlX framework. For more details, click here.
python yayi.py --model-path <path_to_mlx_model> --prompt "### Human: 你好\n### Assistant:"
Prompt template:
### Human: {prompt}
### Assistant:
- Library
- mlx
- Type
- yayi
- License
- other
- Created
- Jan 1, 2024
- Updated
- Jan 1, 2024