Downloads · 30 days
7
2% of all-time downloads
Llama-3.2-3B-Instruct
basecompute/Llama-3.2-3B-Instruct
Llama-3.2-3B-Instruct is a text generation model from basecompute. Use it when you need the model to write or continue text. It is set up for basert. The card lists the license as llama3.2.
BaseRT .base builds of meta-llama/Llama-3.2-3B-Instruct for fast local inference on Apple Silicon (Metal).
All-time downloads
324
Public
Repo size
16.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.base10.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- basert
- License
- llama3.2
- Access
- Public
- Created
- Jun 29, 2026
- Updated
- Jul 30, 2026
- SHA
- c111e66f
Try a prompt
Base models
Model card
From the Hugging Face model README
Llama-3.2-3B-Instruct
BaseRT .base builds of
meta-llama/Llama-3.2-3B-Instruct for fast local inference on Apple
Silicon (Metal).
Files
| File | Precision | Size |
|---|---|---|
Llama-3.2-3B-Instruct-Q4.base | 4-bit | 1.7G |
Llama-3.2-3B-Instruct-Q8.base | 8-bit | 3.1G |
Usage
curl -LsSf https://basecompute.co/install.sh | sh
basert pull basecompute/Llama-3.2-3B-Instruct
basert chat basecompute/Llama-3.2-3B-Instruct
Released under the llama3.2 license, inherited from the base model.
- Task
- Text Generation
- Library
- basert
- License
- llama3.2
- Created
- Jun 29, 2026
- Updated
- Jul 30, 2026