Downloads · 30 days
249
7% of all-time downloads
rombodawg_-_Llama-3-8B-Instruct-Coder-gguf
RichardErkhov/rombodawg_-_Llama-3-8B-Instruct-Coder-gguf
rombodawg_-_Llama-3-8B-Instruct-Coder-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
3.4K
Public
Repo size
92.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf108 GB · 100%
At a glance
- Access
- Public
- Created
- Aug 20, 2024
- Updated
- Aug 20, 2024
- SHA
- c8440e20
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
Llama-3-8B-Instruct-Coder - GGUF
- Model creator: https://huggingface.co/rombodawg/
- Original model: https://huggingface.co/rombodawg/Llama-3-8B-Instruct-Coder/
Original model description:
language:
- en license: apache-2.0 tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
- sft base_model: unsloth/llama-3-8b-Instruct-bnb-4bit
llama-3-8B-Instruct-Coder
This model is llama-3-8b-instruct from Meta (uploaded by unsloth) trained on the full 65k Codefeedback dataset + the additional 150k Code Feedback Filtered Instruction dataset combined. You can find that dataset linked below. This AI model was trained with the new Qalore method developed by my good friend on Discord and fellow Replete-AI worker walmartbag.
The Qalore method uses Qlora training along with the methods from Galore for additional reductions in VRAM allowing for llama-3-8b to be loaded on 14.5 GB of VRAM. This allowed this training to be completed on an RTX A4000 16GB in 130 hours for less than $20.
Qalore notebook for training:
Join the Replete-Ai discord! We are a great and Loving community!
- Created
- Aug 20, 2024
- Updated
- Aug 20, 2024