Downloads · 30 days
5
1% of all-time downloads
jbmarsha/nurse-navigator-GGUF
nurse-navigator-GGUF is a machine learning model from jbmarsha. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is the GGUF version of nurse-navigator for use with Ollama and llama.cpp.
Downloads · 30 days
5
1% of all-time downloads
All-time downloads
366
Public
Repo size
23.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf7.7 GB · 100%
From the Hugging Face model README
This is the GGUF version of nurse-navigator for use with Ollama and llama.cpp.
# Download the model
wget https://huggingface.co/jbmarsha/nurse-navigator-GGUF/resolve/main/nurse_navigator.gguf
# Create Ollama model
cat << 'EOF' > Modelfile
FROM ./nurse_navigator.gguf
SYSTEM "You are an Oncology Nurse Navigator AI assistant specializing in NCCN Guidelines."
PARAMETER temperature 0.3
PARAMETER num_ctx 4096
EOF
ollama create nurse-navigator -f Modelfile
# Run
ollama run nurse-navigator
./main -m nurse_navigator.gguf -p "[INST] Your question here [/INST]"