Downloads · 30 days
4
13% of all-time downloads
Qwen3-4B-Instruct-2507
basecompute/Qwen3-4B-Instruct-2507
Qwen3-4B-Instruct-2507 is a machine learning model from basecompute. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for baseRT. The card lists the license as apache-2.0.
BaseRT .base builds of Qwen/Qwen3-4B-Instruct-2507 for fast local inference on Apple Silicon.
All-time downloads
30
Public
Repo size
7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.base7 GB · 100%
At a glance
- Library
- baseRT
- License
- apache-2.0
- Access
- Public
- Created
- Jun 30, 2026
- Updated
- Jul 2, 2026
- SHA
- a31561f6
Base models
Model card
From the Hugging Face model README
Qwen3-4B-Instruct-2507 (BaseRT)
BaseRT .base builds of
Qwen/Qwen3-4B-Instruct-2507 for fast local inference on Apple Silicon.
| File | Quant |
|---|---|
Qwen3-4B-Instruct-2507-Q4.base | 4-bit (default) |
Qwen3-4B-Instruct-2507-Q8.base | 8-bit |
basert serve basecompute/Qwen3-4B-Instruct-2507 # Q4 (default)
basert serve basecompute/Qwen3-4B-Instruct-2507 --variant default-q8 # Q8
Documentation: https://docs.basecompute.co
- Library
- baseRT
- License
- apache-2.0
- Created
- Jun 30, 2026
- Updated
- Jul 2, 2026