Downloads · 30 days
36
42% of all-time downloads
AlekseyKorshuk/ai-detection-gutenberg-human-formatted-ai-v1-sft-qwen-3b-online-dpo-3epochs
ai-detection-gutenberg-human-formatted-ai-v1-sft-qwen-3b-online-dpo-3epochs is a text generation model from AlekseyKorshuk. Use it when you need the model to write or continue text. It is set up for transformers.
This model is a fine-tuned version of AlekseyKorshuk/ai-detection-gutenberg-human-formatted-ai-v1-sft-qwen-3b on the AlekseyKorshuk/ai-detection-booksum-complete-cleaned-human-ai-trl-online-dpo dataset.
Downloads · 30 days
36
42% of all-time downloads
All-time downloads
86
Public
Parameters
3.4B
6.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.8 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of AlekseyKorshuk/ai-detection-gutenberg-human-formatted-ai-v1-sft-qwen-3b on the AlekseyKorshuk/ai-detection-booksum-complete-cleaned-human-ai-trl-online-dpo dataset. It has been trained using TRL.
from transformers import pipeline
question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
generator = pipeline("text-generation", model="AlekseyKorshuk/ai-detection-gutenberg-human-formatted-ai-v1-sft-qwen-3b-online-dpo-3epochs", device="cuda")
output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
print(output["generated_text"])
This model was trained with Online DPO, a method introduced in Direct Language Model Alignment from Online AI Feedback.
Cite Online DPO as:
@article{guo2024direct,
title = {{Direct Language Model Alignment from Online AI Feedback}},
author = {Shangmin Guo and Biao Zhang and Tianlin Liu and Tianqi Liu and Misha Khalman and Felipe Llinares and Alexandre Ram{'{e}} and Thomas Mesnard and Yao Zhao and Bilal Piot and Johan Ferret and Mathieu Blondel},
year = 2024,
eprint = {arXiv:2402.04792}
}
Cite TRL as:
@misc{vonwerra2022trl,
title = {{TRL: Transformer Reinforcement Learning}},
author = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallouédec},
year = 2020,
journal = {GitHub repository},
publisher = {GitHub},
howpublished = {\url{https://github.com/huggingface/trl}}
}