Downloads · 30 days
0
ush1147/llm-jp-3-13b-it_lora-DPO-12-5
llm-jp-3-13b-it_lora-DPO-12-5 is a machine learning model from ush1147. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: ush1147 - License: apache-2.0 - Finetuned from model : llm-jp/llm-jp-3-13b
Downloads · 30 days
0
Access
Public
Updated Dec 16, 2024
Repo size
501 MB
Likes
0
Public
Click a slice to open those files.
.safetensors501 MB · 99%
From the Hugging Face model README
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/> サンプルコードでまずモデルを生成し、https://matsuolab-geniac.notion.site/FT-DPO-Unsloth-2024-12-2-bac63c15586840b9ad118f5f5b27420aをもとにweblab-GENIAC/aya-ja-nemotron-dpo-masked のデータセットを使用しDPOさせてあります。