Downloads · 30 days
4
2% of all-time downloads
kangqi-ni/Llama-3.1-8B-Instruct_bio-tutor_dpo
Llama-3.1-8B-Instruct_bio-tutor_dpo is a machine learning model from kangqi-ni. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
This model is trained on Llama-3.1-8B-Instruct with SFT and DPO. The purpose is to develop a more capable educational chatbot that helps students study biology.
Downloads · 30 days
4
2% of all-time downloads
All-time downloads
164
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
This model is trained on Llama-3.1-8B-Instruct with SFT and DPO. The purpose is to develop a more capable educational chatbot that helps students study biology.
If you use this work, please cite:
@misc{sonkar2024pedagogical,
title={Pedagogical Alignment of Large Language Models},
author={Shashank Sonkar and Kangqi Ni and Sapana Chaudhary and Richard G. Baraniuk},
year={2024},
eprint={2402.05000},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2402.05000}
}