Downloads · 30 days
9
13% of all-time downloads
Yi-34B-200K-Un-Instruct-1906
adamo1139/Yi-34B-200K-Un-Instruct-1906
Yi-34B-200K-Un-Instruct-1906 is a text generation model from adamo1139. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
1 epoch on adamo1139/uninstruct-v1-experimental-chatml. I used GaLore.\ Purpose of this model is to make the model un-learn to use chatml-specific code words such as: <|imstart|, <|imend|, user, assistant. This is a b…
All-time downloads
68
Public
Parameters
34.4B
68.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors68.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jun 22, 2024
- Updated
- Jun 23, 2024
- SHA
- 1c703ca9
Try a prompt
Model card
From the Hugging Face model README
Basic Model Info
1 epoch on adamo1139/uninstruct-v1-experimental-chatml. I used GaLore.
Purpose of this model is to make the model un-learn to use chatml-specific code words such as: <|im_start|>, <|im_end|>, user, assistant.
This is a base model meant for further finetuning. I think much of OpenAI slop is still left in there, so it's probably best combined with preference optimization method like DPO, ORPO or SPO for best results.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Jun 22, 2024
- Updated
- Jun 23, 2024