Downloads · 30 days
25
3% of all-time downloads
RGarrido03/Gemma-3-Gaia-PT-BR-4b-it-mlx
Gemma-3-Gaia-PT-BR-4b-it-mlx is a text generation model from RGarrido03. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as gemma.
This model is a MLX conversion and 4-bit quantization of the CEIA-UFG/Gemma-3-Gaia-PT-BR-4b-it model. This enables fast inference on Apple Silicon, while keeping the parent model evaluations.
Downloads · 30 days
25
3% of all-time downloads
All-time downloads
751
Public
Parameters
3.9B
2.2 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors2.2 GB · 98%
How the weights are stored.
U323.9B · 100%
From the Hugging Face model README
This model is a MLX conversion and 4-bit quantization of the CEIA-UFG/Gemma-3-Gaia-PT-BR-4b-it model. This enables fast inference on Apple Silicon, while keeping the parent model evaluations.
uv add mlx mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("RGarrido03/Gemma-3-Gaia-PT-BR-4b-it-mlx")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
The conversion was performed using the mlx_lm.convert Python module using the following options:
bfloat16uv run mlx_lm.convert --hf-path CEIA-UFG/Gemma-3-Gaia-PT-BR-4b-it -q --mlx-path Gemma-3-Gaia-PT-BR-4b-it-mlx --dtype bfloat16
André Ribeiro @andreribeiro87
Rúben Garrido @RGarrido03