Downloads · 30 days
9
1% of all-time downloads
zephyr_0.1_a8.0
chujiezheng/zephyr_0.1_a8.0
zephyr_0.1_a8.0 is a text generation model from chujiezheng. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
The extrapolated (ExPO) model based on chujiezheng/zephyr0.1 and alignment-handbook/zephyr-7b-sft-full, as in the "Weak-to-Strong Extrapolation Expedites Alignment" paper.
All-time downloads
1.7K
Public
Parameters
7.2B
14.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Apr 28, 2024
- Updated
- Apr 28, 2024
- SHA
- d23c2df9
Try a prompt
Model card
From the Hugging Face model README
zephyr_0.1_a8.0
The extrapolated (ExPO) model based on chujiezheng/zephyr_0.1 and alignment-handbook/zephyr-7b-sft-full, as in the "Weak-to-Strong Extrapolation Expedites Alignment" paper.
Specifically, we obtain this model by extrapolating from the weights of the SFT and DPO/RLHF checkpoints, achieving superior alignment with human preference.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Languages
- en
- Created
- Apr 28, 2024
- Updated
- Apr 28, 2024