Downloads · 30 days
7
9% of all-time downloads
ODIN-ppo-L230-best
Lichang-Chen/ODIN-ppo-L230-best
ODIN-ppo-L230-best is a text generation model from Lichang-Chen. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is an official implementation of ODIN-ppo-L230-7B model, which is a chat assistant trained by fine-tuning LLaMA on Open-Assistant dataset via PPO. The L230 means the output length in LIMA test set is ~230. ODIN i…
All-time downloads
81
Public
Repo size
35.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin22.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Feb 14, 2024
- Updated
- Feb 14, 2024
- SHA
- 38eac53a
Try a prompt
Model card
From the Hugging Face model README
Model Details
This is an official implementation of ODIN-ppo-L230-7B model, which is a chat assistant trained by fine-tuning LLaMA on Open-Assistant dataset via PPO. The L230 means the output length in LIMA test set is ~230. ODIN is the reward model for the training.
Model Description
<!-- Provide a longer summary of what this model is. -->- Developed by: Lichang-Chen and Chen Zhu
- Model type: RLHF model.
- Language(s) (NLP): English
- Finetuned from model: Vicuna-7b
Model Sources
<!-- Provide the basic links for the model. -->- Repository: ODIN
- Paper: ODIN: Disentangled Reward Mitigates Hacking in RLHF
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Languages
- en
- Created
- Feb 14, 2024
- Updated
- Feb 14, 2024