Downloads · 30 days
0
Student-Guide-llama-3-8b-Instruct-bnb-4bit
arafatanam/Student-Guide-llama-3-8b-Instruct-bnb-4bit
Student-Guide-llama-3-8b-Instruct-bnb-4bit is a machine learning model from arafatanam. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is a fine-tuned version of unsloth/llama-3-8b-Instruct-bnb-4bit, adapted for mental health counseling applications. It is designed to provide thoughtful, relevant, and compassionate responses.
Access
Public
Updated Apr 3, 2025
Repo size
185 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors168 MB · 91%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 3, 2025
- Updated
- Apr 3, 2025
- SHA
- 4ee8cb49
Base models
Model card
From the Hugging Face model README
LLaMA-3-8B-Instruct Fine-Tuned for Mental Health Counseling
Model Overview
This is a fine-tuned version of unsloth/llama-3-8b-Instruct-bnb-4bit, adapted for mental health counseling applications. It is designed to provide thoughtful, relevant, and compassionate responses.
Dataset
- Amod/mental_health_counseling_conversations (cleaned version:
arafatanam/Mental-Health-Counseling) - 2752 rows - chillies/student-mental-health-counseling-vn (translated version:
arafatanam/Student-Mental-Health-Counseling-10K) - 7500 rows - Total dataset size: 10,252 rows
Training Details
- Hardware: Kaggle Notebooks (GPU T4 x2)
- Fine-tuning framework:
UnslothwithLoRA - Training settings:
max_seq_length = 512batch_size = 8gradient_accumulation_steps = 4num_train_epochs = 2learning_rate = 5e-5optimizer = adamw_8bitlr_scheduler = cosine
Training Results
- Final training loss:
1.2433 - Total steps:
640 - Trainable parameters:
0.52%of the model` - Validation loss:
1.182 - Evaluation metric (perplexity):
3.15
Usage
This model can be applied to:
- AI-driven mental health chatbots
- Personalized therapy assistance
- Generating mental health support content
- License
- apache-2.0
- Languages
- en
- Created
- Apr 3, 2025
- Updated
- Apr 3, 2025