Downloads · 30 days
20
8% of all-time downloads
sabersaleh/Llama3
Llama3 is a machine learning model from sabersaleh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This is an aligned model based on princeton-nlp/Llama-3-Base-8B-SFT. The alignment loss has two parts, preference loss and a regularization term. The alignment loss does not require the assumption of an existing under…
Downloads · 30 days
20
8% of all-time downloads
All-time downloads
262
Public
Parameters
8B
112 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
This is an aligned model based on princeton-nlp/Llama-3-Base-8B-SFT. The alignment loss has two parts, preference loss and a regularization term. The alignment loss does not require the assumption of an existing underlying reward model. Moreover, the distribution's ``softness" is adjustable via the softmax exponent, an algorithm parameter.
More information will be added later.