Downloads · 30 days
14
2% of all-time downloads
zephyr-7b-beta-llamafile
TimeSurgeLabs/zephyr-7b-beta-llamafile
zephyr-7b-beta-llamafile is a machine learning model from TimeSurgeLabs. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Original Model: Zephyr 7B Beta Quantized Model: Zephyr 7B Beta GGUF Llamafile Source Code: Mozilla-Ocho/llamafile + Built with Llamafile 5ea929c
All-time downloads
669
Public
Repo size
8.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.llamafile8.7 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Dec 8, 2023
- Updated
- Dec 13, 2023
- SHA
- 04aa815c
Model card
From the Hugging Face model README
Zephyr 7B Beta Llamafiles
See here for a guide on how to use llamafiles!
- Original Model: Zephyr 7B Beta
- Quantized Model: Zephyr 7B Beta GGUF
- Llamafile Source Code: Mozilla-Ocho/llamafile
- Built with Llamafile
5ea929c
- Built with Llamafile
Both the server and the CLI are based on TheBloke's Zephyr 7B Beta GGUF Q4_K_M model.
Usage
NOTE: Due to the executable being greater than 4GB, it is currently not compatible with Windows. I will update with a Windows friendly version of Zephyr 7B Beta when I can.
# replace with the CLI if you prefer
wget https://huggingface.co/TimeSurgeLabs/zephyr-7b-beta-llamafile/resolve/main/zephyr-beta-server.llamafile
chmod +x zephyr-beta-server.llamafile
./zephyr-beta-server.llamafile
- License
- apache-2.0
- Created
- Dec 8, 2023
- Updated
- Dec 13, 2023