Downloads · 30 days
3
25% of all-time downloads
Meta-Llama-3-8B-Instruct
anthonymikinka/Meta-Llama-3-8B-Instruct
Meta-Llama-3-8B-Instruct is a text generation model from anthonymikinka. Use it when you need the model to write or continue text. The card lists the license as llama3.
This repository contains a Core ML conversion of meta-llama/Meta-Llama-3-8B
All-time downloads
12
Public
Repo size
16.1 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin16.1 GB · 100%
At a glance
- Task
- Text Generation
- License
- llama3
- Access
- Public
- Created
- Jul 5, 2024
- Updated
- Jul 8, 2024
- SHA
- 5d4b0ed2
Try a prompt
Model card
From the Hugging Face model README
Meta Llama 3 8B – Core ML
This repository contains a Core ML conversion of meta-llama/Meta-Llama-3-8B
This does not have KV Cache. only: inputs int32 / outputs float16.
I haven't been able to test this, so leave something in 'Community' to let me know how ya tested it and how it worked.
I did model.half() before scripting / coverting thinking it would reduce my memory usage (I found online that it doesn't).
I am unsure if it affected the conversion process or not.
- Task
- Text Generation
- License
- llama3
- Languages
- en
- Created
- Jul 5, 2024
- Updated
- Jul 8, 2024