Downloads · 30 days
58
19% of all-time downloads
E-motionAssistant/llama-3.2-3b-english-therapy-GGUF
llama-3.2-3b-english-therapy-GGUF is a machine learning model from E-motionAssistant. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Quantized GGUF version of LLaMA 3.2-3B fine-tuned for empathetic therapy conversations.
Downloads · 30 days
58
19% of all-time downloads
All-time downloads
301
Public
Repo size
2 GB
Likes
0
Public
Click a slice to open those files.
.gguf2 GB · 100%
From the Hugging Face model README
Quantized GGUF version of LLaMA 3.2-3B fine-tuned for empathetic therapy conversations.
# Download the model
wget https://huggingface.co/pavishanth-sujeevan/llama-3.2-3b-english-therapy-GGUF/resolve/main/model.gguf
# Run inference
./llama-cli -m model.gguf -p "I'm feeling anxious about my future" -n 200
from llama_cpp import Llama
llm = Llama(
model_path="model.gguf",
n_ctx=2048,
n_threads=4,
n_gpu_layers=35
)
output = llm(
"User: I'm feeling stressed about work.\nTherapist:",
max_tokens=200,
temperature=0.7,
top_p=0.9
)
print(output["choices"][0]["text"])
import streamlit as st
from llama_cpp import Llama
@st.cache_resource
def load_model():
return Llama(model_path="model.gguf", n_ctx=2048, n_gpu_layers=35)
llm = load_model()
user_input = st.text_input("How are you feeling?")
if user_input:
response = llm(f"User: {user_input}\nTherapist:", max_tokens=200)
st.write(response["choices"][0]["text"])
This model is designed for:
Apache 2.0 (inherits from LLaMA 3.2 base model)