Downloads · 30 days
16
2% of all-time downloads
DrRiceIO7/HereticFT-Aggressive
HereticFT-Aggressive is a text generation model from DrRiceIO7. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Originally, I wanted to try fine tuning my model with DPO but I couldn't figure out how to get Unsloth to do it using Gemma based models, so this is based on regular old SFT. It still got that abrasive edge though, so…
Downloads · 30 days
16
2% of all-time downloads
All-time downloads
866
Public
Parameters
4.3B
8.6 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors8.6 GB · 100%
From the Hugging Face model README
Originally, I wanted to try fine tuning my model with DPO but I couldn't figure out how to get Unsloth to do it using Gemma based models, so this is based on regular old SFT. It still got that abrasive edge though, so I'm calling it a partial success, on account of it seeming a little bit unstable. Next plan: try out a new architecture.
This gemma3 model was trained 2x faster with Unsloth and Huggingface's TRL library.