Downloads · 30 days
0
llama-3.2-1B-instruct-coreml-ane
seba/llama-3.2-1B-instruct-coreml-ane
llama-3.2-1B-instruct-coreml-ane is a machine learning model from seba. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Access
Public
Updated Oct 11, 2024
Repo size
2.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.zip2.1 GB · 100%
At a glance
- Access
- Public
- Created
- Oct 11, 2024
- Updated
- Oct 11, 2024
- SHA
- 171ad167
Model card
From the Hugging Face model README
Example commmand to run:
python -m src.coreml_example --model-path-mf ./Llama-3.2-1B-4bits-MF.mlmodelc --model-path-head ./Llama-3.2-1B-HEAD-6Bits.mlmodelc/ --model-path-emb ./Llama-3.2-1B-EMB-16Bits.mlmodelc --prompt "Write a poem joke about Harry Potter" --max-tokens 400 --temp 1.2
You need to have set HF_TOKEN or provide on execution
- Created
- Oct 11, 2024
- Updated
- Oct 11, 2024