Downloads · 30 days
0
adamo1139/Yi-34B-200K-XLCTX-RAWrr-3004-LoRA
Yi-34B-200K-XLCTX-RAWrr-3004-LoRA is a machine learning model from adamo1139. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
~~1704 and 1804 RAWrr Yi-34B-200K-xlctx loras came out bad, which I realized now. I had HDD drive failure and it was the one holding up Linux that training was happening on. Probably that's why.~~ Nah, it was transfor…
Downloads · 30 days
0
Access
Public
Updated May 27, 2024
Repo size
983 MB
Likes
0
Public
Click a slice to open those files.
.safetensors983 MB · 100%
From the Hugging Face model README
1704 and 1804 RAWrr Yi-34B-200K-xlctx loras came out bad, which I realized now. I had HDD drive failure and it was the one holding up Linux that training was happening on. Probably that's why.
Nah, it was transformers or peft python update that broke my merging process. I downgraded and it works. 1704/1804/3004 loras are fine, I think 1804 is the best one.
3004 is a re-train with 1804 config - higher lr than 1704.