gemma-2b-it-Code-Instruct-ft-122k_alpaca_style

Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->

Instruct Fine-tuning Gemma using qLora and Supervise Finetuning

Model Details

Model Description

<!-- Provide a longer summary of what this model is. -->

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

• Developed by:
• Funded by [optional]: azurehorizon
• Model type: gemma-2b-it
• Language(s) (NLP): English,
• License: gemma
• Finetuned from model [optional]: gemma-2b-it

Training Data

<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->

TokenBender/code_instructions_122k_alpaca_style

Summary

'global_step'=100, 'train_samples_per_second': 0.501, 'train_steps_per_second': 0.125, 'total_flos': 907555205713920.0, 'train_loss': 0.99025949716568,

• Hardware Type: T4 GPU
• Hours used: 0:13 H
• Cloud Provider: Google Colab