Downloads · 30 days
180
30% of all-time downloads
Macaw-OptiQ-4bit
mlx-community/Macaw-OptiQ-4bit
Macaw-OptiQ-4bit is a text generation model from mlx-community. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as other.
Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no PyTorch and no cloud. All OptiQ quants · Docs · LFM2.5 family
All-time downloads
591
Public
Parameters
2.7B
2 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors2 GB · 99%
Parameter types
How the weights are stored.
U322.7B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
mlx-community/Macaw-OptiQ-4bit
Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no PyTorch and no cloud. All OptiQ quants · Docs · LFM2.5 family
An OptiQ mixed-precision quant of badtheorylabs/Macaw, an on-device Mac assistant built on LFM2.5-2.6B. 1.93 GB on disk, down from 5.2 GB at bf16.
Macaw is a tool-calling agent, so the quant is aimed at keeping tool calls well formed rather than at raw benchmark scores.
What it is
| Property | Value |
|---|---|
| Base | badtheorylabs/Macaw (LFM2.5-2.6B derivative) |
| Architecture | lfm2 — hybrid conv + full attention, 30 layers |
| Method | OptiQ mixed-precision, per-layer bit allocation reused from the base family |
| On disk | 1.93 GB (bf16: 5.2 GB) |
| Context | 128k |
Macaw keeps its base architecture, so which layers tolerate fewer bits is unchanged. The per-layer allocation comes from LFM2.5-2.6B-OptiQ-4bit rather than a fresh sensitivity sweep: 167 of 167 layers matched, 80 kept at 8-bit and 87 at 4-bit.
Run it
pip install mlx-optiq
optiq serve --model mlx-community/Macaw-OptiQ-4bit
That gives you an OpenAI and Anthropic compatible endpoint with mixed-precision KV cache, tool-call healing and prompt caching. The base model's recommended sampling ships in generation_config.json and optiq serve applies it without any flags.
Links
- Project website: mlx-optiq.com
- All OptiQ quants: mlx-optiq.com/models
- PyPI: pypi.org/project/mlx-optiq
- Base model: badtheorylabs/Macaw
- Task
- Text Generation
- Library
- mlx
- Type
- lfm2
- License
- other
- Languages
- en
- Created
- Aug 6, 2026
- Updated
- Sep 15, 2026