Downloads · 30 days
28
4% of all-time downloads
Goraint/medgemma-4b-it-MLX-AWQ-4bit
medgemma-4b-it-MLX-AWQ-4bit is a machine learning model from Goraint. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as gemma.
A 4-bit AWQ quantized version of Google/medgemma-4b-it optimized for efficient inference using the MLX library, designed to handle long-context tasks (192k tokens) with reduced resource usage. Retains core capabilitie…
Downloads · 30 days
28
4% of all-time downloads
All-time downloads
688
Public
Parameters
4.6B
2.7 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors2.6 GB · 99%
How the weights are stored.
U324.6B · 100%
From the Hugging Face model README
A 4-bit AWQ quantized version of Google/medgemma-4b-it optimized for efficient inference using the MLX library, designed to handle long-context tasks (192k tokens) with reduced resource usage. Retains core capabilities of medgemma-4b while enabling deployment on edge devices.