Downloads · 30 days
46
2% of all-time downloads
Llama-3.2-8B-Instruct
tu9jn/Llama-3.2-8B-Instruct
Llama-3.2-8B-Instruct is a machine learning model from tu9jn. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
2.3K
Public
Repo size
4.9 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf4.9 GB · 100%
At a glance
- Access
- Public
- Created
- Oct 5, 2024
- Updated
- Oct 5, 2024
- SHA
- 93a11d7f
Model card
From the Hugging Face model README
LLama 3.2 8B Instruct in gguf format
This is the text only part of the Llama 3.2 11b Vision Instruct model.
I removed the vision, multimodal and cross attention layers, and renamed the rest in line with the regular llama models.
Lastly, I trimmed off 8 rows from model.embed_tokens.weight to [128256, 4096], and removed the image token from the tokenizer.
It has a touch less perplexity than Llama 8.1 8B, so maybe it will be useful to someone.
- Created
- Oct 5, 2024
- Updated
- Oct 5, 2024