Skip to content

XueyingJia

pythia-1b-online-dpo-SG-merge-sfairXC-judge

XueyingJia/pythia-1b-online-dpo-SG-merge-sfairXC-judge

pythia-1b-online-dpo-SG-merge-sfairXC-judge is a machine learning model from XueyingJia. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

This model is a fine-tuned version of XueyingJia/pythia-1b-sft-SG-merge on the XueyingJia/Children-Stories-Collection-Filtered-Alignment dataset. It has been trained using TRL.

Downloads · 30 days

0

Access

Public

Updated Dec 9, 2024

Repo size

105 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors4.2 MB · 54%

At a glance

Library
transformers
Access
Public
Created
Dec 9, 2024
Updated
Dec 9, 2024
SHA
3f20570d

Base models

Library
transformers
Created
Dec 9, 2024
Updated
Dec 9, 2024