Downloads · 30 days
3
9% of all-time downloads
tinyrolls/Llama3_8B_sft_dpo
Llama3_8B_sft_dpo is a machine learning model from tinyrolls. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Checkpoint from the RoleVerse project — a multilingual benchmark for social reasoning through same-universe role-playing across 5 languages (EN, ZH, JA, FR, ES).
Downloads · 30 days
3
9% of all-time downloads
All-time downloads
34
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
Checkpoint from the RoleVerse project — a multilingual benchmark for social reasoning through same-universe role-playing across 5 languages (EN, ZH, JA, FR, ES).
This checkpoint was produced by the RoleVerse training pipeline (SFT and/or DPO). See the project repo and dataset for details on how it was trained.
tinyrolls/Llama3_8B_sft_dpofrom transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "tinyrolls/Llama3_8B_sft_dpo"
tok = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype="auto", device_map="auto")