Downloads · 30 days
11
5% of all-time downloads
jquirion/Llama-Guard-3-1B-Q4_K_M
Llama-Guard-3-1B-Q4_K_M is a machine learning model from jquirion. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.2.
This model is a Q4KM quantized version of meta-llama/Llama-Gard-3-1B and is provided in GGUF file format. It is intended for fast execution at the edge using llama.cpp or ollama.
Downloads · 30 days
11
5% of all-time downloads
All-time downloads
213
Public
Repo size
955 MB
Likes
0
Public
Click a slice to open those files.
.gguf955 MB · 100%
From the Hugging Face model README
This model is a Q4_K_M quantized version of meta-llama/Llama-Gard-3-1B and is provided in GGUF file format. It is intended for fast execution at the edge using llama.cpp or ollama.
1B parameters 955.4 MB size Q4_K_M quantization
This model is a Q4_K_M quantized version of meta-llama/Llama-Gard-3-1B and is provided in GGUF file format. It is intended for fast execution at the edge using llama.cpp or ollama.
Runing using ollama: ollama run hf.co/jquirion/Llama-Guard-3-1B-Q4_K_M
The model predicts safety labels on the 13 categories shown below, based on the MLCommons taxonomy of 13 hazards.
Hazard categories:
S1: Violent Crimes S2: Non-Violent Crimes S3: Sex-Related Crimes S4: Child Sexual Exploitation S5: Defamation S6: Specialized Advice S7: Privacy S8: Intellectual Property S9: Indiscriminate Weapons S10: Hate S11: Suicide & Self-Harm S12: Sexual Content S13: Elections