Downloads · 30 days
830
11% of all-time downloads
Llama-3-8B-Instruct-Coder-GGUF
QuantFactory/Llama-3-8B-Instruct-Coder-GGUF
Llama-3-8B-Instruct-Coder-GGUF is a text generation model from QuantFactory. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- This is Quantized version of rombodawg/Llama-3-8B-Instruct-Coder created using llama.cpp
All-time downloads
7.5K
Public
Repo size
72.7 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf72.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- May 5, 2024
- Updated
- May 6, 2024
- SHA
- e5522b1b
Try a prompt
Base models
Model card
From the Hugging Face model README
llama-3-8B-Instruct-Coder-GGUF
- This is Quantized version of rombodawg/Llama-3-8B-Instruct-Coder created using llama.cpp
Model Description
This model is llama-3-8b-instruct from Meta (uploaded by unsloth) trained on the full 65k Codefeedback dataset + the additional 150k Code Feedback Filtered Instruction dataset combined. You can find that dataset linked below. This AI model was trained with the new Qalore method developed by my good friend on Discord and fellow Replete-AI worker walmartbag.
The Qalore method uses Qlora training along with the methods from Galore for additional reductions in VRAM allowing for llama-3-8b to be loaded on 14.5 GB of VRAM. This allowed this training to be completed on an RTX A4000 16GB in 130 hours for less than $20.
Dataset used for training this model:
Qalore notebook for training:
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- May 5, 2024
- Updated
- May 6, 2024