Downloads · 30 days
18
10% of all-time downloads
LLama-3-Instruct-8B-GGUF
Ba2han/LLama-3-Instruct-8B-GGUF
LLama-3-Instruct-8B-GGUF is a machine learning model from Ba2han. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Should be working properly with KoboldCPP and other stuff. I changed EOS token to <|eotid| and this prevents endless generation.
All-time downloads
178
Public
Repo size
15.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf15.1 GB · 100%
At a glance
- Access
- Public
- Created
- Apr 28, 2024
- Updated
- May 17, 2024
- SHA
- 3ebed8b8
Model card
From the Hugging Face model README
Should be working properly with KoboldCPP and other stuff. I changed EOS token to <|eot_id|> and this prevents endless generation.
I also converted original weights back to fp32 before quantization.
Edit: Highly recommending you to download more recent quants. 17/05/2024
- Created
- Apr 28, 2024
- Updated
- May 17, 2024