lemer-mlx-8bit

LetheanNetwork/lemer-mlx-8bit

lemer-mlx-8bit is a image-text-to-text model from LetheanNetwork. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.

Gemma 4 E2B in MLX format, 8-bit quantized, converted from LetheanNetwork/lemer's bf16 safetensors via mlxlm.convert. Higher-precision sibling of LetheanNetwork/lemer-mlx (which is 4-bit). For the LEK-merged variant see

Downloads · 30 days

17% of all-time downloads

All-time downloads

Public

Parameters

4.6B

5 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors4.9 GB · 99%

Parameter types

How the weights are stored.

U324.6B · 100%

Try a prompt

Base models

google/gemma-4-E2B-it

Model card

From the Hugging Face model README

LetheanNetwork/lemer-mlx-8bit

Gemma 4 E2B in MLX format, 8-bit quantized, converted from LetheanNetwork/lemer's bf16 safetensors via mlx_lm.convert. Higher-precision sibling of LetheanNetwork/lemer-mlx (which is 4-bit). For the LEK-merged variant see lthn/lemer.

Variants in this family

Repo	Format	Bits	Use case
`LetheanNetwork/lemer`	safetensors + gguf Q4_K_M	bf16 / 4	Source weights + llama.cpp/Ollama
`LetheanNetwork/lemer-mlx`	mlx	4	Apple Silicon default
`LetheanNetwork/lemer-mlx-8bit`	mlx	8	This repo — higher precision
`LetheanNetwork/lemer-mlx-bf16`	mlx	bf16	Full-precision reference

Usage

from mlx_lm import load, generate

model, tokenizer = load("LetheanNetwork/lemer-mlx-8bit")
response = generate(
    model, tokenizer,
    prompt=tokenizer.apply_chat_template(
        [{"role": "user", "content": "Hello"}],
        add_generation_prompt=True,
        enable_thinking=True,
    ),
    max_tokens=512,
)

Provenance

Source: LetheanNetwork/lemer bf16 safetensors (= google/gemma-4-E2B-it)
Converter: mlx_lm.convert (mlx-lm — LM Studio / Apple ML Research)
Quant: 8-bit group quantization, ~8.5 bits/weight effective
License: Apache 2.0 (Gemma Terms of Use)

License

Apache 2.0, subject to the Gemma Terms of Use.

Task: Image-Text-to-Text
Library: mlx
Type: gemma4
License: apache-2.0
Created: Apr 11, 2026
Updated: Apr 11, 2026