Downloads · 30 days
170
12% of all-time downloads
hllzmz/medgemma-mentalist-gguf
medgemma-mentalist-gguf is a machine learning model from hllzmz. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
GGUF quantizations for medgemma-mentalist.
Downloads · 30 days
170
12% of all-time downloads
All-time downloads
1.4K
Public
Repo size
129 GB
Likes
0
Public
Click a slice to open those files.
.gguf64.5 GB · 100%
From the Hugging Face model README
GGUF quantizations for medgemma-mentalist.
unsloth/medgemma-27b-text-itmedgemma-mentalist-q4_k_m.ggufmedgemma-mentalist-q5_k_m.ggufmedgemma-mentalist-q8_0.ggufMedGemma Mentalist is a specialized Mental Health Assistant model fine-tuned on top of Google's medgemma-27b. It has been trained using with high-quality synthetic client-therapist dialogues.
This model is designed to understand users' emotional states, interpret described experiences through the lens of mental health and clinical standards, and provide supportive guidance using a warm, empathetic tone.
This model is NOT a licensed medical professional.
This quantized models can be run with llama-cli, LM Studio or something that able to run gguf models. For optimal performance and role adherence, please strictly follow the recommended prompts and parameters below.
SYSTEM_PROMPT = """
You are MedGemma Mentalist, an advanced AI mental health assistant designed to provide empathetic support, scientifically grounded psychoeducation, and guidance.
Your goal is to be a bridge to professional help and a source of reliable mental health information.
You should NEVER diagnose or stigmatize the user directly.
"""
To prevent the model from hallucinating or accidentally roleplaying as the client (User), the following generation settings are highly recommended:
Temperature: 0.3 - 0.5 (Lower values ensure the model remains objective and grounded in mental health knowledge).
Repetition Penalty: 1.1 (Prevents the model from getting stuck in loops).