Downloads · 30 days
23
11% of all-time downloads
Gemma3-Callous-Calla-4B-mlx
Daizee/Gemma3-Callous-Calla-4B-mlx
Gemma3-Callous-Calla-4B-mlx is a text generation model from Daizee. Use it when you need the model to write or continue text. It is set up for mlx-lm.
This repo hosts MLX-converted variants of Daizee/Gemma3-Callous-Calla-4B for fast, local inference on Apple Silicon (M-series). Tokenizer/config are included at the repo root. MLX weight folders live under mlx/.
All-time downloads
214
Public
Repo size
8.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.4 GB · 98%
At a glance
- Task
- Text Generation
- Library
- mlx-lm
- Model type
- gemma3
- Access
- Public
- Created
- Nov 7, 2025
- Updated
- Nov 7, 2025
- SHA
- 1eb80af3
Try a prompt
Base models
Model card
From the Hugging Face model README
Gemma3-Callous-Calla-4B — MLX builds (Apple Silicon)
This repo hosts MLX-converted variants of Daizee/Gemma3-Callous-Calla-4B for fast, local inference on Apple Silicon (M-series).
Tokenizer/config are included at the repo root. MLX weight folders live under mlx/.
Note on vocab padding: For MLX compatibility, the tokenizer/embeddings were padded to the next multiple of 64 tokens.
In this build: 262,208 tokens (added 64 placeholder tokens named<pad_ex_*>).
Variants
| Path | Bits | Group Size | Notes |
|---|---|---|---|
mlx/g128/ | int4 | 128 | Smallest & fastest |
mlx/g64/ | int4 | 64 | Slightly larger, often steadier |
mlx/int8/ | 8 | — | Closest to fp16 quality (slower) |
Quickstart (MLX-LM)
Run from Hugging Face (no cloning needed)
python -m mlx_lm.generate \
--model hf://Daizee/Gemma3-Callous-Calla-4B-mlx/mlx/g64 \
--prompt "Summarize the Bill of Rights for 7th graders in 4 bullet points." \
--max-tokens 180 --temp 0.3 --top-p 0.92
- Task
- Text Generation
- Library
- mlx-lm
- Type
- gemma3
- Created
- Nov 7, 2025
- Updated
- Nov 7, 2025