Downloads · 30 days
15
2% of all-time downloads
Yi-1.5-34B-32K-rebased-1406
adamo1139/Yi-1.5-34B-32K-rebased-1406
Yi-1.5-34B-32K-rebased-1406 is a text generation model from adamo1139. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Yi-1.5-34B-32K finetuned via SFT on adamo1139/uninstruct-v1-experimental-chatml. Then trained via ORPO on adamo1139/rawrrv2-2stage1. It's an attempt to fix synthetic SFT contamination of original Yi-1.5-34B-32K.
All-time downloads
823
Public
Parameters
34.4B
68.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors68.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jun 14, 2024
- Updated
- Nov 6, 2024
- SHA
- 076e39d9
Try a prompt
Model card
From the Hugging Face model README
Yi-1.5-34B-32K finetuned via SFT on adamo1139/uninstruct-v1-experimental-chatml. Then trained via ORPO on adamo1139/rawrr_v2-2_stage1. It's an attempt to fix synthetic SFT contamination of original Yi-1.5-34B-32K.
Next up:
Cleaning and releasing AEZAKMI v4 dataset.
Training this model on it. Maybe adding some toxic-dpo-natural on it if needed. Releasing it.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Jun 14, 2024
- Updated
- Nov 6, 2024