nomadrp
dpo_model
Tags
- safetensors
- trl
- dpo
- generated_from_trainer
- base_model:meta-llama/Llama-3.1-8B-Instruct
- base_model:adapter:meta-llama/Llama-3.1-8B-Instruct
- license:llama3.1
- region:us
- Author
- nomadrp
- Library
- peft
- License
- llama3.1
- Base model
- meta-llama/Meta-Llama-3.1-8B-Instruct
- Downloads
- 8
- Likes
- 0