gemma-4-12B-it-qat-JANG_4M

OsaurusAI/gemma-4-12B-it-qat-JANG_4M

gemma-4-12B-it-qat-JANG_4M is a image-text-to-text model from OsaurusAI. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as gemma.

<p align="center"<a href="https://osaurus.ai"<img src="./osaurus-x-banner.png" alt="Osaurus AI"</a</p

Downloads · 30 days

5% of all-time downloads

All-time downloads

1.4K

Public

Parameters

12B

18.2 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors10.1 GB · 100%

Parameter types

How the weights are stored.

U3210.9B · 91%

Try a prompt

Base models

google/gemma-4-12B-it-qat-q4_0-unquantized

Model card

From the Hugging Face model README

OsaurusAI/gemma-4-12B-it-qat-JANG_4M

JANG_4M MLX affine bundle converted from google/gemma-4-12B-it-qat-q4_0-unquantized.

This bundle keeps Gemma 4 bookends and media-sensitive components coherent: token embeddings/output projection, norms, media towers/embedders, and Gemma 4 per-layer embedding/gate/projector tensors are fp16 passthrough; self-attention and MoE router projections are 8-bit affine; decoder MLP/expert bulk is 4-bit affine.

Bundle

Field	Value
Source	`google/gemma-4-12B-it-qat-q4_0-unquantized`
Architecture	`gemma4_unified` / `Gemma4UnifiedForConditionalGeneration`
Text layers	48
Hidden size	3840
Weight format	`jang_affine`
Top-level quantization	bits=8, group_size=32, mode=affine
Tier bits	attention=8, router=8, mlp=4, embed=16, per_layer_media=16
Quantized modules	328 affine bases with `.scales` and `.biases` sidecars
Shards	10 safetensors shards
Preserved source modalities	text, vision, audio
Verified current vMLX runtime	text-only

Modalities

Modality	Status
Text	verified through the vMLX JANG text loader
Vision	source config and weights are present and preserved; standard `mlx_vlm` does not yet provide `gemma4_unified` runtime support
Audio	`audio_config` and audio embedder weights are present and preserved; standard `mlx_vlm` does not yet provide `gemma4_unified` runtime support
Video	No `video_config` is present, so this card does not claim a verified video runtime path.

Runtime support depends on a Gemma 4 compatible MLX/vMLX loader that understands config.json quantization overrides, jang_config.json, and Gemma 4 processor/chat-template files. The current verified path is text-only through vMLX's JANG loader; vision/audio require a real gemma4_unified VLM implementation.

Runtime Metadata

config.json has source-derived has_vision, has_audio, has_video, modalities, and capabilities.
tokenizer_config.json includes bos_token_id, eos_token_id, pad_token_id, and the patched Gemma 4 chat template.
processor_config.json is preserved for Gemma 4 multimodal processing.
MTP/speculative drafter weights are not present in the source checkpoint; metadata is mtp: none / mtp_policy: none.

Task: Image-Text-to-Text
Library: mlx
Type: gemma4_unified
License: gemma
Languages: en
Created: Jun 9, 2026
Updated: Aug 31, 2026