gemma-Summarizer-2b-it-bnb-4bit

Uploaded as 4bit model

• Developed by: Labagaite
• License: apache-2.0
• Finetuned from model : unsloth/gemma-2b-it-bnb-4bit

Training Logs

Summary metrics

Best ROUGE-1 score : 0.9981203007518796

Best ROUGE-2 score : 0.9981167608286252

Best ROUGE-L score : 0.9981203007518796

Wandb logs

You can view the training logs <img src="https://raw.githubusercontent.com/wandb/wandb/main/docs/README_images/logo-light.svg" width="200"/>.

Training details

training data

• Dataset : fr-summarizer-dataset
• Data-size : 7.65 MB
• train : 1.97k rows
• validation : 440 rows
• roles : user , assistant
• Format chatml "role": "role", "content": "content", "user": "user", "assistant": "assistant" <br>

French audio podcast transcription

Project details

<img src="https://avatars.githubusercontent.com/u/116890814?v=4" width="100"/> Fine-tuned on French audio podcast transcription data for summarization task. As a result, the model is able to summarize French audio podcast transcription data. The model will be used for a AI application: Report Maker wich is a powerful tool designed to automate the process of transcribing and summarizing meetings. It leverages state-of-the-art machine learning models to provide detailed and accurate reports.

This gemma model was trained 2x faster with Unsloth and Huggingface's TRL library.

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>