Downloads · 30 days
37
3% of all-time downloads
guardiangate1775/gemma-4-26B-A4B-it-assistant-8bit
gemma-4-26B-A4B-it-assistant-8bit is a text generation model from guardiangate1775. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as gemma.
This model was converted to MLX format from mlx-community/gemma-4-26B-A4B-it-assistant-bf16 using mlx-vlm version 0.5.0. Refer to the original model card for more details on the model.
Downloads · 30 days
37
3% of all-time downloads
All-time downloads
1.5K
Public
Parameters
420M
478 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors446 MB · 93%
How the weights are stored.
U32420M · 100%
From the Hugging Face model README
This model was converted to MLX format from mlx-community/gemma-4-26B-A4B-it-assistant-bf16
using mlx-vlm version 0.5.0.
Refer to the original model card for more details on the model.
pip install -U mlx-vlm
python -m mlx_vlm.generate --model guardiangate1775/gemma-4-26B-A4B-it-assistant-8bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>