Downloads · 30 days
4
4% of all-time downloads
FTK11558/Llama-3-8B-Instruct-RR-Broken-APS-vllm
Llama-3-8B-Instruct-RR-Broken-APS-vllm is a machine learning model from FTK11558. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
https://github.com/fhdnskfbeuv/AdaptiveProbeSteering/tree/main/vllmsteeredplugins
Downloads · 30 days
4
4% of all-time downloads
All-time downloads
93
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
https://github.com/fhdnskfbeuv/AdaptiveProbeSteering/tree/main/vllm_steered_plugins
Roughly achieve 90%+ StrongReject Scores. APS paper
Llama-3-8B-Instruct-RR is a Llama-3 model with circuit breakers inserted using Representation Rerouting (RR).
Circuit Breaking is a new approach inspired by representation engineering, designed to prevent AI systems from generating harmful content by directly altering harmful model representations, with minimal capability degradation. For more information, please check out our paper.
<p align="center"> <img src="https://github.com/GraySwanAI/circuit-breakers/raw/main/assets/llama_splash.png" width="800"/> </p>