Downloads · 30 days
0
RWKV-5.2-3b-World-DPO
OpenMOSE/RWKV-5.2-3b-World-DPO
RWKV-5.2-3b-World-DPO is a machine learning model from OpenMOSE. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Access
Public
Updated Mar 4, 2024
Repo size
6.1 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.pth6.1 GB · 100%
At a glance
- Access
- Public
- Created
- Mar 4, 2024
- Updated
- Mar 4, 2024
- SHA
- 8ae00307
Model card
From the Hugging Face model README
license: apache-2.0
a DPO LoRA fine-tuned model with preference dataset
LoRA Experiment
RWKV-5.2-3b-World-DPO is merged model with base
Base Model
RWKV-5-World-3B-v2-20231113-ctx4096
Parameters: Lora Rank 8 Lora Alpha 16 ctx length 4096 epoch:19
Dataset Randomly chosed 1000pairs https://huggingface.co/datasets/HuggingFaceH4/ultrafeedback_binarized
- Created
- Mar 4, 2024
- Updated
- Mar 4, 2024