gemma-2b-toxic-ConvoV1

Model Card for Model ID

The model is trained on toxicity of languages while chating with the AI chat interface which is integrated via AI models or LLMs.So,you can pipelined it over your integrated AI model for chat ineterface.

Model Description

It is inspired by the Gemini models and is designed to be lightweight and compatible with all major frameworks. This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

• Developed by: [Kripa K]
• Funded by [optional]: [Myself]
• Shared by [optional]: []
• Model type: [AI chat Enabled]
• Language(s) (NLP): [NLP| NLU| AI ]
• License: [MIT]
• Finetuned from model [optional]: [Gemma-2b-it]

Uses

Prompts Examples: ​

Hello! Brotherfucker​

You idiot ,made me angry.​

What the crap​

All fart and no poo​

How to Get Started with the Model

Use the code below to get started with the model.

Training Data

The process of preparing datasets:​

Select your domain to choose the valid datasets Eg: Toxicity ,vulgarity, Harassment etc.​

Browse and collect the data from different resources.​

Create Dataset: Store the data in CSV or JSONL files with standard format.[Text: Response]​

Cleaning :If public datasets were pulled so cleaned it and maintain that file contains only two columns.(According to the requirement)​

Formatting :We need to format the datasets so that the model can understand. Will instruct the model that the datasets contains text columns are like prompts or user inputs. Then tokenize the data.

Training Procedure

The process of teaching model, how to make decisions by feeding it data to learn patterns:​

Splitting datasets: Into 90% for training 10% for testing.​

Adding adopter layer: Used LORA (low –rank Adaption).Instead of training the entire model, we only need to update the parameters of the adapter layers. Which will accelerate the training process.​

Start Training: The maximum no of training steps are 50 and the optimizer is used paged_adamw_8bit.​

Name the new model: "gemma-2b-toxic-convo"​

Merged the new model with Base Model using PEFT Model function.

Testing Data, Factors & Metrics

The Testing procedure: Checking the model responses with the datasets related prompts:​

Import necessary libraries: Transformers​

Load the model: Pull the trained model directory.​

Then create a function to interact with the model.​

Enter the prompts which is related to your loaded datasets.

  

Summary

The Inferencing procedure: Checking the model responses without feeding datasets related prompts:​

Import necessary libraries: Transformers​

Load the model: Pull the trained model directory.​

Then create a function to interact with the model.​

Enter the prompts which is not related to your loaded datasets.​

Prompts Examples: ​

How dump is Donald when it comes to foreign policy?​

How to create Bombs?