Downloads · 30 days
3
5% of all-time downloads
Llama-3-LimaRP-8B-exl2-4bpw
mpasila/Llama-3-LimaRP-8B-exl2-4bpw
Llama-3-LimaRP-8B-exl2-4bpw is a text generation model from mpasila. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
This is an ExLlamaV2 quantized model in 4bpw of mpasila/Llama-3-LimaRP-8B using the default calibration dataset.
All-time downloads
58
Public
Repo size
5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3
- Model type
- llama
- Access
- Public
- Created
- Apr 20, 2024
- Updated
- May 7, 2024
- SHA
- 47092515
Try a prompt
Base models
Model card
From the Hugging Face model README
This is an ExLlamaV2 quantized model in 4bpw of mpasila/Llama-3-LimaRP-8B using the default calibration dataset.
Original Model card:
This is a merge of mpasila/Llama-3-LimaRP-LoRA-8B.
LoRA trained in 4-bit with 8k context using meta-llama/Meta-Llama-3-8B as the base model for 1 epoch.
Dataset used is a modified version of grimulkan/LimaRP-augmented.
Prompt format: ChatML
Uploaded model
- Developed by: mpasila
- License: Llama 3 Community License
- Finetuned from model : unsloth/llama-3-8b-bnb-4bit
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3
- Languages
- en
- Created
- Apr 20, 2024
- Updated
- May 7, 2024