Downloads · 30 days
20
13% of all-time downloads
tg-rising/gemma-3-12b-it-heretic-v2-MLX-VLM-Q8
gemma-3-12b-it-heretic-v2-MLX-VLM-Q8 is a image-text-to-text model from tg-rising. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx.
This is a vision-capable 8-bit MLX-converted version of DreamFast/gemma-3-12b-it-heretic-v2.
Downloads · 30 days
20
13% of all-time downloads
All-time downloads
156
Public
Parameters
13.2B
14.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors14.4 GB · 100%
How the weights are stored.
U3212.8B · 97%
From the Hugging Face model README
This is a vision-capable 8-bit MLX-converted version of DreamFast/gemma-3-12b-it-heretic-v2.
This model includes vision support for image understanding!
This model is part of a complete family with both text-only and vision-capable variants:
| Variant | Quantization | Size | HF Repo | Use Case |
|---|---|---|---|---|
| BF16 | None | 22 GB | tg-rising/gemma-3-12b-it-heretic-v2-MLX-BF16 | Text generation |
| Q8 | 8-bit | 12 GB | tg-rising/gemma-3-12b-it-heretic-v2-MLX-Q8 | Text generation |
| Q6 | 6-bit | 8.9 GB | tg-rising/gemma-3-12b-it-heretic-v2-MLX-Q6 | Text generation |
| Q4 | 4-bit | 6.2 GB | tg-rising/gemma-3-12b-it-heretic-v2-MLX-Q4 | Text generation |
| Variant | Quantization | Size | HF Repo | Use Case |
|---|---|---|---|---|
| BF16 | None | 25 GB | tg-rising/gemma-3-12b-it-heretic-v2-MLX-VLM-BF16 | Image + Text |
| Q8 | 8-bit | 13 GB | tg-rising/gemma-3-12b-it-heretic-v2-MLX-VLM-Q8 | Image + Text |
| Q6 | 6-bit | 11 GB | tg-rising/gemma-3-12b-it-heretic-v2-MLX-VLM-Q6 | Image + Text |
| Q4 | 4-bit | 7.5 GB | tg-rising/gemma-3-12b-it-heretic-v2-MLX-VLM-Q4 | Image + Text |
pip install -U mlx-vlm
# Analyze an image
python -m mlx_vlm.generate \
--model tg-rising/gemma-3-12b-it-heretic-v2-MLX-VLM-Q8 \
--prompt "Describe this image in detail." \
--image /path/to/image.jpg \
--max-tokens 100
from mlx_vlm import load, generate
from mlx_vlm.prompt_utils import apply_chat_template
from mlx_vlm.utils import load_config
# Load model
model_path = "tg-rising/gemma-3-12b-it-heretic-v2-MLX-VLM-Q8"
model, processor = load(model_path)
config = load_config(model_path)
# Prepare image + text
image = ["/path/to/image.jpg"]
prompt = "What is in this image?"
# Apply chat template
formatted_prompt = apply_chat_template(
processor, config, prompt, num_images=len(image)
)
# Generate
output = generate(model, processor, formatted_prompt, image, max_tokens=100)
print(output)
This model is subject to the Gemma license.