Downloads · 30 days
8
13% of all-time downloads
Llama-3-1-8B-Instruct-Unsloth-LoRA-4bit
vhab10/Llama-3-1-8B-Instruct-Unsloth-LoRA-4bit
Llama-3-1-8B-Instruct-Unsloth-LoRA-4bit is a text generation model from vhab10. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This model is a fine-tuned version of the Meta LLaMA 3.1 8B Instruct model. It has been fine-tuned using the Unsloth library with 4-bit quantization for efficient inference and deployment. The fine-tuning process util…
All-time downloads
62
Public
Parameters
8.2B
5.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.7 GB · 100%
Parameter types
How the weights are stored.
U87.2B · 87%
Try a prompt
Base models
Model card
From the Hugging Face model README
Overview
This model is a fine-tuned version of the Meta LLaMA 3.1 8B Instruct model. It has been fine-tuned using the Unsloth library with 4-bit quantization for efficient inference and deployment. The fine-tuning process utilized a synthetic dataset from @AI Maker Space consisting of acronyms and their expanded forms in English and was performed using the LoRA (Low-Rank Adaptation) technique, specifically designed for instruction-based tasks. It can be easily deployed in low-resource environments thanks to the 4-bit quantization.
Uploaded model
- Developed by: vhab10
- License: apache-2.0
- Finetuned from model : unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Languages
- en
- Created
- Sep 22, 2024
- Updated
- Oct 7, 2024