Downloads · 30 days
1
0% of all-time downloads
Llama-3.1-Literotica-LoRA-8B
mpasila/Llama-3.1-Literotica-LoRA-8B
Llama-3.1-Literotica-LoRA-8B is a machine learning model from mpasila. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as llama3.1.
Dataset used: mpasila/Literotica-stories-short which contains only a subset of the stories from the full Literotica dataset and was chunked down to fit within 8192 tokens.
All-time downloads
307
Public
Repo size
5.5 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors5.5 GB · 100%
At a glance
- Library
- peft
- License
- llama3.1
- Access
- Public
- Created
- Sep 13, 2024
- Updated
- Sep 13, 2024
- SHA
- f7b053b3
Base models
Datasets
Model card
From the Hugging Face model README
Dataset used: mpasila/Literotica-stories-short which contains only a subset of the stories from the full Literotica dataset and was chunked down to fit within 8192 tokens.
Prompt format is: No formatting
Merged model: mpasila/Llama-3.1-Literotica-8B
Trained with regular LoRA (not quantized/QLoRA) and LoRA rank was 128 and Alpha set to 32. Trained for 1 epoch using A40 for about 13 hours.
Uploaded model
- Developed by: mpasila
- License: Llama 3.1 Community License Agreement
- Finetuned from model : unsloth/meta-llama-3.1-8b
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Library
- peft
- License
- llama3.1
- Languages
- en
- Created
- Sep 13, 2024
- Updated
- Sep 13, 2024