Z3R6X

Llama-3-8B-ORPO-V1

Z3R6X/Llama-3-8B-ORPO-V1

Llama-3-8B-ORPO-V1 is a text generation model from Z3R6X. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.

Llama 3 8B finetuned on mlabonne/orpo-dpo-mix-40k with ORPO.\ Max length was reduced to 1024 tokens. LoRA (r=16) and 4bit quantization was used to increase memory efficiency.