Downloads · 30 days
23
6% of all-time downloads
nishparadox/granite-guardian-3.2-5b-multi-harm-GGUF
granite-guardian-3.2-5b-multi-harm-GGUF is a machine learning model from nishparadox. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Merged model of ibm-granite/granite-guardian-3.2-5b + ibm-granite/granite-guardian-3.2-5b-lora-harm-categories LoRA adapter.
Downloads · 30 days
23
6% of all-time downloads
All-time downloads
375
Public
Repo size
23.1 GB
Likes
1
Public
Click a slice to open those files.
.gguf11.6 GB · 100%
From the Hugging Face model README
Merged model of ibm-granite/granite-guardian-3.2-5b + ibm-granite/granite-guardian-3.2-5b-lora-harm-categories LoRA adapter.
ollama run hf.co/nishparadox/granite-guardian-3.2-5b-multi-harm-GGUF:F16
llama-cli -m granite-guardian-3.2-5b-multi-harm-f16.gguf -p "Your prompt"
See original model card for full prompt template.