Downloads · 30 days
11
2% of all-time downloads
GuelGaMesh01/gemma-2b-it-finetuned-mental-health-qa
gemma-2b-it-finetuned-mental-health-qa is a text generation model from GuelGaMesh01. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This model is a fine-tuned version of gemma-2b-it for mental health counseling conversations. It was fine-tuned on the Amod/Mental Health Counseling Conversations dataset, which contains dialogues related to mental he…
Downloads · 30 days
11
2% of all-time downloads
All-time downloads
565
Public
Parameters
2.5B
15.4 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors5.3 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of gemma-2b-it for mental health counseling conversations. It was fine-tuned on the Amod/Mental Health Counseling Conversations dataset, which contains dialogues related to mental health counseling.
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
This model is fine-tuned for generating responses related to mental health counseling tasks. It can be used for providing suggestions, conversation starters, or follow-ups in mental health scenarios.
This model can be adapted for use in more specific counseling-related tasks, or in applications where generating mental health-related dialogue is necessary.
The model is not intended to replace professional counseling. It should not be used for real-time crisis management or any situation requiring direct human intervention. Use in highly critical or urgent care situations is out of scope.
The model was trained on mental health-related dialogues, but it may still generate biased or inappropriate responses. Users should exercise caution when interpreting or acting on the model's outputs, particularly in sensitive scenarios.
The model should not be used as a replacement for professional mental health practitioners. Users should carefully evaluate generated responses in the context of their use case.
Use the code below to get started with the model.
from transformers import AutoModelForCausalLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("GuelGaMesh01/gemma-2b-it-finetuned-mental-health-qa")
model = AutoModelForCausalLM.from_pretrained("GuelGaMesh01/gemma-2b-it-finetuned-mental-health-qa")
inputs = tokenizer("How can I manage anxiety better?", return_tensors="pt") outputs = model.generate(**inputs, max_length=200) response = tokenizer.decode(outputs[0], skip_special_tokens=True) print(response)
The model was trained on the Amod/Mental Health Counseling Conversations dataset, which consists of mental health dialogues focused on counseling situations.
The model was fine-tuned using LoRA (Low-Rank Adaptation) with the following hyperparameters:
Batch Size: 1 Gradient Accumulation Steps: 4 Learning Rate: 2e-4 Epochs: 3 Max Sequence Length: 2500 tokens Optimizer: paged_adamw_8bit
The model was evaluated using a split from the training data, specifically a 10% test split of the original training dataset.
The following metrics were used during the training and evaluation process: