Downloads · 30 days
19
35% of all-time downloads
GPT2_NonToxic
pt-sk/GPT2_NonToxic
GPT2_NonToxic is a text generation model from pt-sk. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Aligning the model using Proximal Policy Optimization (PPO). The goal is to train the model to generate non-toxic reviews. The training process utilizes the trl library for reinforcement learning, the transformers lib…
All-time downloads
55
Public
Parameters
124M
498 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors498 MB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- Jul 15, 2024
- Updated
- Jul 15, 2024
- SHA
- 9e74c5bb
Try a prompt
Datasets
Model card
From the Hugging Face model README
Aligning the model using Proximal Policy Optimization (PPO). The goal is to train the model to generate non-toxic reviews. The training process utilizes the trl library for reinforcement learning, the transformers library for model handling, and datasets for dataset management.
Implementation code is available here: GitHub
# Load model and tokenizer directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("pt-sk/GPT2_NonToxic")
model = AutoModelForCausalLM.from_pretrained("pt-sk/GPT2_NonToxic")
# Example usage
input_text = "The movie was fantastic"
inputs = tokenizer(input_text, return_tensors='pt')
outputs = model.generate(**inputs)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- mit
- Created
- Jul 15, 2024
- Updated
- Jul 15, 2024