Skip to content

ikimhope

pythia-1b-tldr-online-dpo-mark-peft

ikimhope/pythia-1b-tldr-online-dpo-mark-peft

pythia-1b-tldr-online-dpo-mark-peft is a machine learning model from ikimhope. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

This model is a fine-tuned version of trl-lib/pythia-1b-deduped-tldr-sft on the trl-lib/tldr dataset. It has been trained using TRL.

Downloads · 30 days

0

Access

Public

Updated Oct 7, 2024

Repo size

67.1 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors33.6 MB · 90%

At a glance

Library
transformers
Access
Public
Created
Oct 6, 2024
Updated
Oct 7, 2024
SHA
646b0cf3

Base models

Datasets

Library
transformers
Created
Oct 6, 2024
Updated
Oct 7, 2024