Downloads · 30 days
17
27% of all-time downloads
Qwen3-4B-Computer-Science-MLX-8bit
Irfanuruchi/Qwen3-4B-Computer-Science-MLX-8bit
Qwen3-4B-Computer-Science-MLX-8bit is a text generation model from Irfanuruchi. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
An Apple MLX 8-bit quantized version of Qwen3-4B-Computer-Science, optimized for efficient local inference on Apple Silicon Macs.
All-time downloads
64
Public
Parameters
4B
4.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.3 GB · 100%
Parameter types
How the weights are stored.
U324B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3-4B-Computer-Science-MLX-8bit
An Apple MLX 8-bit quantized version of Qwen3-4B-Computer-Science, optimized for efficient local inference on Apple Silicon Macs.
This repository provides an MLX-compatible model for fast inference while maintaining excellent quality with significantly reduced memory usage.
Base Model
- Base repository:
Irfanuruchi/Qwen3-4B-Computer-Science - Architecture: Qwen3-4B
- Format: MLX
- Quantization: 8-bit
- Group Size: 64
Features
- Optimized for Apple Silicon (M-series)
- Fast local inference using MLX
- Reduced memory footprint
- Compatible with
mlx-lm
Installation
python3 -m venv .venv
source .venv/bin/activate
pip install mlx mlx-lm
Usage
mlx_lm.generate \
--model Irfanuruchi/Qwen3-4B-Computer-Science-MLX-8bit \
--prompt "Write a Python function that validates an IPv4 address." \
--max-tokens 256
License
This model is released under the Apache 2.0 License.
The original Qwen3 model is licensed under Apache 2.0. This repository contains an MLX quantized version of the original weights.
Acknowledgements
- Alibaba Qwen Team
- Apple MLX
- Hugging Face
- Task
- Text Generation
- Library
- mlx
- Type
- qwen3
- License
- apache-2.0
- Created
- Jul 25, 2026
- Updated
- Jul 25, 2026