Downloads · 30 days
0
mistral-7b-wilburbot
wlbrcodes/mistral-7b-wilburbot
mistral-7b-wilburbot is a machine learning model from wlbrcodes. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Fine tuning a Mistral-7b model from hf mlx, and then deploying it as a Telegram bot.
Access
Public
Updated Oct 1, 2024
Repo size
4.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.3 GB · 97%
At a glance
- Access
- Public
- Created
- Oct 1, 2024
- Updated
- Oct 1, 2024
- SHA
- 6e98369c
Model card
From the Hugging Face model README
llm-stuff
Fine tuning a Mistral-7b model from hf mlx, and then deploying it as a Telegram bot.
Inspired by: https://www.youtube.com/watch?v=3PIqhdRzhxE
Local Fine-tuning on Mac (QLoRA with MLX)
Code hacked from here: https://github.com/ml-explore/mlx-examples/tree/main/lora
How to Setup
- Clone repo
- Create Python env
python -m venv mlx-env
- Activate env (bash/zsh)
source mlx-env/bin/activate
- Install requirements
pip install -r requirements.txt
Note: MLX has the following requirements. More info here.
- Using an M series chip (Apple silicon)
- Using a native Python >= 3.8
- macOS >= 13.5 (MacOS 14 recommended)
- Created
- Oct 1, 2024
- Updated
- Oct 1, 2024