Downloads · 30 days
4
7% of all-time downloads
Karko/toxic-sharegpt-dpo-m7b-v0.2-8k-ctx
toxic-sharegpt-dpo-m7b-v0.2-8k-ctx is a text generation model from Karko. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a finetuned version of Mistral Instruct v0.2 with Undi95's toxicsharegpt-NoWarning.jsonl. (while writing this I realize that it is not the DPO version but the NoWarning version! OOps!)
Downloads · 30 days
4
7% of all-time downloads
All-time downloads
58
Public
Repo size
29 GB
Likes
0
Public
Click a slice to open those files.
.bin14.5 GB · 100%
From the Hugging Face model README
This is a finetuned version of Mistral Instruct v0.2 with Undi95's toxicsharegpt-NoWarning.jsonl. (while writing this I realize that it is not the DPO version but the NoWarning version! OOps!)
The finetuned was made at 8K context length in LoRA using axolotl.
The goal of this finetune was to check the validity of a 32K context despite a training at a way much lower context length (8k).