Downloads · 30 days
59
1% of all-time downloads
RichardErkhov/thu-coai_-_ShieldLM-13B-baichuan2-gguf
thu-coai_-_ShieldLM-13B-baichuan2-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
59
1% of all-time downloads
All-time downloads
4.6K
Public
Repo size
144 GB
Likes
0
Public
Click a slice to open those files.
.gguf171 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
ShieldLM-13B-baichuan2 - GGUF
| Name | Quant method | Size |
|---|---|---|
| ShieldLM-13B-baichuan2.Q2_K.gguf | Q2_K | 5.36GB |
| ShieldLM-13B-baichuan2.Q3_K_S.gguf | Q3_K_S | 6.15GB |
| ShieldLM-13B-baichuan2.Q3_K.gguf | Q3_K | 6.75GB |
| ShieldLM-13B-baichuan2.Q3_K_M.gguf | Q3_K_M | 6.75GB |
| ShieldLM-13B-baichuan2.Q3_K_L.gguf | Q3_K_L | 7.14GB |
| ShieldLM-13B-baichuan2.IQ4_XS.gguf | IQ4_XS | 7.2GB |
| ShieldLM-13B-baichuan2.Q4_0.gguf | Q4_0 | 7.44GB |
| ShieldLM-13B-baichuan2.IQ4_NL.gguf | IQ4_NL | 7.5GB |
| ShieldLM-13B-baichuan2.Q4_K_S.gguf | Q4_K_S | 7.8GB |
| ShieldLM-13B-baichuan2.Q4_K.gguf | Q4_K | 8.38GB |
| ShieldLM-13B-baichuan2.Q4_K_M.gguf | Q4_K_M | 8.38GB |
| ShieldLM-13B-baichuan2.Q4_1.gguf | Q4_1 | 8.21GB |
| ShieldLM-13B-baichuan2.Q5_0.gguf | Q5_0 | 8.98GB |
| ShieldLM-13B-baichuan2.Q5_K_S.gguf | Q5_K_S | 9.14GB |
| ShieldLM-13B-baichuan2.Q5_K.gguf | Q5_K | 9.62GB |
| ShieldLM-13B-baichuan2.Q5_K_M.gguf | Q5_K_M | 9.62GB |
| ShieldLM-13B-baichuan2.Q5_1.gguf | Q5_1 | 9.75GB |
| ShieldLM-13B-baichuan2.Q6_K.gguf | Q6_K | 11.25GB |
| ShieldLM-13B-baichuan2.Q8_0.gguf | Q8_0 | 13.75GB |
license: mit language:
The ShieldLM model (paper link) initialized from Baichuan2-13B-Chat. ShieldLM is a bilingual (Chinese and English) safety detector that mainly aims to help to detect safety issues in LLMs' generations. It aligns with general human safety standards, supports fine-grained customizable detection rules, and provides explanations for its decisions. Refer to our github repository for more detailed information.
Please refer to our github repository for the detailed usage instructions.
ShieldLM demonstrates impressive detection performance across 4 ID and OOD test sets, compared to strong baselines such as GPT-4, Llama Guard and Perspective API. Refer to our paper for more detailed evaluation results.