gemma-3-1b-haikuspec

Uploaded model

• Developed by: axel-darmouni
• License: apache-2.0
• Finetuned from model : unsloth/gemma-3-1b-it-unsloth-bnb-4bit

This gemma3_text model was trained 2x faster with Unsloth and Huggingface's TRL library.

This gemma3 model aims to improve gemma-3-1b-it's ability to generate haikus given the prefix "Generate a haiku about the following topic: {topic}". Topics tested were less than a sentence long. Model was trained using the axel-darmouni/haiku_dataset.

Results of all training runs in the training github can be found below:

The fullrun which is the model uploaded uses a combination of sft, rl with sparse rewards polished by a run with continuous rewards.

Warning: it is however worth noting the haiku reward might be biased, due to issues with the pyphen library, used to identify haikus.

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>