Downloads · 30 days
76
1% of all-time downloads
alignment-model-test3
4season/alignment-model-test3
alignment-model-test3 is a text generation model from 4season. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is test version, alignment-tuned model.
All-time downloads
8.1K
Public
Parameters
21.4B
42.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors42.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Mar 29, 2024
- Updated
- Mar 29, 2024
- SHA
- e29bc3a6
Try a prompt
Model card
From the Hugging Face model README
4season/model_eval_test3
Introduction
This model is test version, alignment-tuned model.
We utilize state-of-the-art instruction fine-tuning methods including direct preference optimization (DPO). After DPO training, we linearly merged models to boost performance.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Mar 29, 2024
- Updated
- Mar 29, 2024