Downloads · 30 days
28
1% of all-time downloads
TheCarBun/GPT-2-fine-tuned-mental-health
GPT-2-fine-tuned-mental-health is a text generation model from TheCarBun. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
[](https://huggingface.co/TheCarBun/GPT-2-fine-tuned-mental-health) [](https://opensource.org/licenses/Apache-2.0)
Downloads · 30 days
28
1% of all-time downloads
All-time downloads
4.4K
Public
Parameters
124M
498 MB on disk
Likes
4
Public
Click a slice to open those files.
.safetensors498 MB · 99%
From the Hugging Face model README
This is a fine-tuned GPT-2 model specialized for mental health support conversations. It provides empathetic responses to users feeling distressed, stressed, or anxious. This model is trained on a custom dataset with carefully crafted conversational data.
🚀 Use case: AI-driven mental health support chatbot.
🛠 Base Model: GPT-2
📁 Dataset: Custom dataset based on intents.json + Kaggle conversational dataset
| File | Description |
|---|---|
config.json | Model configuration |
pytorch_model.bin | Model weights |
tokenizer.json | Tokenizer configuration |
vocab.json | Vocabulary file |
training_args.bin | Training hyperparameters |
generation_config.json | Generation settings |
The model was fine-tuned on Google Colab using the Hugging Face Transformers library.
Training was performed using:
5e-585| Epoch | Training Loss | Validation Loss |
|---|---|---|
| 1 | 1.1932 | 1.0248 |
| 2 | 0.7532 | 0.7870 |
| 3 | 0.7520 | 0.6927 |
| 4 | 0.6018 | 0.6580 |
| 5 | 0.5192 | 0.6403 |
You can load and use the model with Hugging Face Transformers:
from transformers import pipeline
# Load the model
chatbot = pipeline("text-generation", model="TheCarBun/GPT-2-fine-tuned-mental-health")
# Test the chatbot
user_input = "I feel so alone."
response = chatbot(f"User: {user_input} AI:", max_length=50)
print(response[0]['generated_text'])
📝 Note: If running locally, install dependencies first:
pip install transformers torch
This model is licensed under the Apache 2.0 License. You are free to use, modify, and distribute it with proper attribution.
📌 Hugging Face Model Link: GPT-2 Fine-Tuned Mental Health
✨ If you find this model useful, give it a star on Hugging Face! ⭐