Downloads · 30 days
8
15% of all-time downloads
smolllama-detox-ppo
MattBou00/smolllama-detox-ppo
smolllama-detox-ppo is a text generation model from MattBou00. Use it when you need the model to write or continue text. It is set up for transformers.
FINETUNEDTOXICMODEL = "MattBou00/SmolLM-toxic-finetuned" TOXICITYCLASSIFIER = "s-nlp/robertatoxicityclassifier" DATASETNAME = "skrishna/toy-toxicity-dataset"
All-time downloads
53
Public
Parameters
135M
538 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors538 MB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- May 26, 2025
- Updated
- May 27, 2025
- SHA
- 04315a2d
Try a prompt
Model card
From the Hugging Face model README
Model Card for Model ID
FINE_TUNED_TOXIC_MODEL = "MattBou00/SmolLM-toxic-finetuned" TOXICITY_CLASSIFIER = "s-nlp/roberta_toxicity_classifier" DATASET_NAME = "skrishna/toy-toxicity-dataset"
HF_REPO_ID_RLHF = "MattBou00/SmolLM-detoxified-rlhf-v5" WORK_DIR = "./rlhf_outputs" MODEL_DIR = f"{WORK_DIR}/policy"
PPO_BATCH_SIZE = 16 PPO_MINI_BATCH_SIZE = 4 PPO_LR = 1e-5 PPO_MAX_GRAD_NORM = 1.0 PPO_EPOCHS = 4 DATA_FRACTION = 0.05
MAX_NEW_TOKENS = 30 TEMPERATURE = 1.0 SEED = 42 os.environ["WANDB_MODE"] = "disabled"
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- May 26, 2025
- Updated
- May 27, 2025