Downloads · 30 days
48
4% of all-time downloads
MiniCPM5-1B-MLX-DWQ-4bit
Reza2kn/MiniCPM5-1B-MLX-DWQ-4bit
MiniCPM5-1B-MLX-DWQ-4bit is a text generation model from Reza2kn. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
MLX 4-bit quantization of openbmb/MiniCPM5-1B.
All-time downloads
1.1K
Public
Parameters
1.1B
608 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors608 MB · 98%
Parameter types
How the weights are stored.
U321.1B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
MiniCPM5-1B MLX DWQ 4-bit
MLX 4-bit quantization of openbmb/MiniCPM5-1B.
Quantization
- Runtime: MLX / mlx-lm
- Bits: 4
- Group size: 64
- Mode: affine
- Observed packed size: about 580 MB
- Conversion log:
mlx_lm.convertreported4.501 bits per weight
Smoke Test
Local Apple M2 smoke test:
- Prompt tokens: 17
- Prompt speed: 28.621 tok/s
- Generation speed: 133.897 tok/s
- Peak memory: 0.674 GB
Validation Status
Runtime loading and generation work, but this artifact is not yet release-approved on the strict multilingual/code/tool-use validation matrix. Known failures include Persian response quality, Arabic arithmetic response quality, and reasoning leakage on tool-planning prompts.
Usage
pip install -U mlx-lm
mlx_lm.generate --model Reza2kn/MiniCPM5-1B-MLX-DWQ-4bit --prompt "Hello" --max-tokens 64
Licensing and attribution
This model distribution is licensed under the Apache License, Version 2.0. See LICENSE. Existing third-party copyright, license, and attribution notices remain applicable.
- Upstream: openbmb/MiniCPM5-1B; declared license:
apache-2.0.
- Task
- Text Generation
- Library
- mlx
- Type
- llama
- License
- apache-2.0
- Created
- May 26, 2026
- Updated
- Sep 9, 2026