Downloads · 30 days
5
9% of all-time downloads
Llama-3-Instruct-LiPPA-8B-exl2-4.7bpw
mpasila/Llama-3-Instruct-LiPPA-8B-exl2-4.7bpw
Llama-3-Instruct-LiPPA-8B-exl2-4.7bpw is a text generation model from mpasila. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
This is an ExLlamaV2 quantized model in 4.7bpw of mpasila/Llama-3-Instruct-LiPPA-8B using the default calibration dataset with 8192 context length.
All-time downloads
56
Public
Repo size
5.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3
- Model type
- llama
- Access
- Public
- Created
- May 18, 2024
- Updated
- May 18, 2024
- SHA
- fb66998c
Try a prompt
Base models
Model card
From the Hugging Face model README
This is an ExLlamaV2 quantized model in 4.7bpw of mpasila/Llama-3-Instruct-LiPPA-8B using the default calibration dataset with 8192 context length.
Original Model card:
This is a merge of mpasila/Llama-3-LiPPA-LoRA-8B.
LoRA trained in 4-bit with 8k context using meta-llama/Meta-Llama-3-8B-Instruct as the base model for 1 epoch.
Dataset used is mpasila/LimaRP-PIPPA-Mix-8K-Context which was made using grimulkan/LimaRP-augmented and KaraKaraWitch/PIPPA-ShareGPT-formatted.
This has been trained on the instruct model and not the base model. The model trained with the base model using the same dataset is here: mpasila/Llama-3-LiPPA-8B
This also seems to work fairly well for chatting.
Prompt format: Llama 3 Instruct
Unsloth changed assistant to gpt and user to human.
Uploaded model
- Developed by: mpasila
- License: Llama 3 Community License
- Finetuned from model : unsloth/llama-3-8b-Instruct-bnb-4bit
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3
- Languages
- en
- Created
- May 18, 2024
- Updated
- May 18, 2024