Downloads · 30 days
16
8% of all-time downloads
OrpoLlama-3-8B
mayacinka/OrpoLlama-3-8B
OrpoLlama-3-8B is a text generation model from mayacinka. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Quick Llama 3 8B finetune with ORPO. Demontration that it can be fine tune in 2 hours only. Thanks to Maxime Labonne's notebook:
All-time downloads
209
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Apr 19, 2024
- Updated
- Apr 20, 2024
- SHA
- c4d44550
Try a prompt
Datasets
Model card
From the Hugging Face model README
Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->Quick Llama 3 8B finetune with ORPO. Demontration that it can be fine tune in 2 hours only. Thanks to Maxime Labonne's notebook:
https://colab.research.google.com/drive/1eHNWg9gnaXErdAa8_mcvjMupbSS6rDvi?usp=sharing
- Number of training samples from the dataset: 1500 out of 40K
- Hardware Type: L4
- Hours of training: 2
- Cloud Provider: google colab
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Apr 19, 2024
- Updated
- Apr 20, 2024