Downloads · 30 days
18
17% of all-time downloads
GPT-OSS-20B-HESOYAM-1108-WIP-CHATML
adamo1139/GPT-OSS-20B-HESOYAM-1108-WIP-CHATML
GPT-OSS-20B-HESOYAM-1108-WIP-CHATML is a machine learning model from adamo1139. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GPT-OSS-20B fine-tuned on adamo1139/HESOYAMv0.4 dataset, 1 epoch, chatml format that erases reasoning. 1024 rank, 128 alpha QLoRA made with Unsloth. It will be undergoing further preference alignment once some issues…
All-time downloads
103
Public
Parameters
20.9B
41.9 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors41.8 GB · 100%
At a glance
- Model type
- gpt_oss
- Access
- Public
- Created
- Aug 11, 2025
- Updated
- Aug 11, 2025
- SHA
- 07ba4631
Base models
Datasets
Model card
From the Hugging Face model README
GPT-OSS-20B fine-tuned on adamo1139/HESOYAM_v0.4 dataset, 1 epoch, chatml format that erases reasoning. 1024 rank, 128 alpha QLoRA made with Unsloth. It will be undergoing further preference alignment once some issues preventing me from doing it right now will be patched out.
Total batch size 16, learning rate 0.0002 with cosine schedule, with sample packing enabled. Training took about 8 hours on single 3090 Ti.
Loss curve looks a bit underwhelming.
I tried merging this lora with the huizimao/gpt-oss-20b-uncensored-mxfp4 but that wasn't producing great effects.
No reasoning is present, and model definitely learns something from the dataset, but it feels pretty dumb, so it could be a wrong path.
- Type
- gpt_oss
- Created
- Aug 11, 2025
- Updated
- Aug 11, 2025