Downloads · 30 days
699
17% of all-time downloads
adamo1139/Danube3-4b-4chan-HESOYAM-2510-GGUF
Danube3-4b-4chan-HESOYAM-2510-GGUF is a text generation model from adamo1139. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Quants for adamo1139/danube3-4b-4chan-hesoyam-2510 are available in this repo
Downloads · 30 days
699
17% of all-time downloads
All-time downloads
4.2K
Public
Repo size
33.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf33.3 GB · 100%
From the Hugging Face model README
Quants for adamo1139/danube3-4b-4chan-hesoyam-2510 are available in this repo
I finetuned Danube3 4B Base on adamo1139/uninstruct-v1-experimental-chatml dataset with the goal being making AI assistant slop less likely.
Then I did finetuning on adamo1139/4chan_archive_ShareGPT_only5 which is a filtered collection of 4chan threads from various boards for 1 epoch to introduce 4chan-specific slang.
Then I did finetuning on adamo1139/HESOYAM_v0.4 for 3 epochs to improve 1-on-1 chat capabilities.
This is a resulting model.
Use ChatML prompt format.
System message should be in the format as below:
A chat on 4chan board /3/
A chat on 4chan board /g/
A chat on 4chan board /x/
A chat on 4chan board /pol/
I am still vibe-checking the model but initial results are good. I might have put in a bit too much reddit style from HESOYAM, not sure.