Downloads · 30 days
14
23% of all-time downloads
AlphaOxO/Lizzy-7B-8bits-MLX
Lizzy-7B-8bits-MLX is a text generation model from AlphaOxO. Use it when you need the model to write or continue text. It is set up for mlx.
Quant by mlx-lm 0.31.3 with new pipeline for lizzy modeltype
Downloads · 30 days
14
23% of all-time downloads
All-time downloads
61
Public
Parameters
7.3B
7.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors7.8 GB · 100%
How the weights are stored.
U327.3B · 100%
From the Hugging Face model README
Quant by mlx-lm 0.31.3 with new pipeline for lizzy model_type
mlx_lm.generate mlx_lm.generate --model /path/to/model --prompt "What is different between CPU and GPU?" --max-tokens 2048 --trust-remote-code
# or
mlx_lm.chat --model /path/to/model --max-tokens 2048 --trust-remote-code