Downloads · 30 days
9
2% of all-time downloads
Nicoesp/Gemopus-4-E4B-it-MLX-4bit
Gemopus-4-E4B-it-MLX-4bit is a machine learning model from Nicoesp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as gemma.
This is a 4-bit quantization of Jackrong/Gemopus-4-E4B-it converted to MLX format.
Downloads · 30 days
9
2% of all-time downloads
All-time downloads
599
Public
Parameters
7.5B
4.3 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors4.2 GB · 99%
How the weights are stored.
U327.5B · 100%
From the Hugging Face model README
This is a 4-bit quantization of Jackrong/Gemopus-4-E4B-it converted to MLX format.
pip install mlx-lm
python -m mlx_lm.generate --model Nicoesp/Gemopus-4-E4B-it-MLX-4bit --prompt "Ciao!"