Downloads · 30 days
18
17% of all-time downloads
polish-lobotomy
DuckyBlender/polish-lobotomy
polish-lobotomy is a text generation model from DuckyBlender. Use it when you need the model to write or continue text. It is set up for transformers.
Polish-Lobotomy: An awful polish fine-tune ============================================================
All-time downloads
108
Public
Parameters
3.8B
7.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- phi3
- Access
- Public
- Created
- May 15, 2024
- Updated
- Apr 2, 2025
- SHA
- 57cca802
Model card
From the Hugging Face model README
Polish-Lobotomy: An awful polish fine-tune
Model Description
This fine-tuned Phi-3 model is my first attempt at a Polish fine-tune of Phi-3. It is very bad, probably because of the fine-tuning method (making the model learn a new language probably needs a full fine-tune) and the small dataset.
Training Details
- Trained on a single RTX 4060 for approximately 1 hour
- Utilized 8-bit QLORA for efficient training
- Despite the short training period, the model somehow managed to learn something (but not very well)
Dataset
The model was trained on a chaotic telegram group chat. It's basically complete lobotomy.
Prompt Template
The prompt template used for this model is identical to the Phi 3 template.
Disclaimer
Please be advised that this model's output may contain nonsensical responses. Viewer discretion is strongly advised (but not really necessary).
Use this model at your own risk, and please engage with the output responsibly (but let's be real, it's not like it's going to be useful for anything).
- Task
- Text Generation
- Library
- transformers
- Type
- phi3
- Languages
- pl
- Created
- May 15, 2024
- Updated
- Apr 2, 2025