Downloads · 30 days
0
Llama-3.2-3B-Instruct-CoreML
smpanaro/Llama-3.2-3B-Instruct-CoreML
Llama-3.2-3B-Instruct-CoreML is a machine learning model from smpanaro. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.2.
CoreML conversion of Llama-3.2-3B-Instruct with a 512 context length. Optimized for Apple Neural Engine.
Access
Public
Updated Nov 9, 2024
Repo size
7.2 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.bin7.2 GB · 100%
At a glance
- License
- llama3.2
- Access
- Public
- Created
- Nov 9, 2024
- Updated
- Nov 9, 2024
- SHA
- 691b3b7b
Base models
Model card
From the Hugging Face model README
CoreML conversion of Llama-3.2-3B-Instruct with a 512 context length. Optimized for Apple Neural Engine.
Use this CLI to download and run inference. macOS 14 (Sonoma) is required.
[!IMPORTANT] This model will likley run slowly or not at all on M1 Macs and phones. Consider trying the 1B model for those devices: smpanaro/Llama-3.2-1B-Instruct-CoreML
- License
- llama3.2
- Created
- Nov 9, 2024
- Updated
- Nov 9, 2024