Downloads · 30 days
126K
2% of all-time downloads
dummy-GPT2-correct-vocab
trl-internal-testing/dummy-GPT2-correct-vocab
dummy-GPT2-correct-vocab is a text generation model from trl-internal-testing. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
8M
Public
Parameters
1.7M
62.4 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors6.6 MB · 66%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Feb 8, 2023
- Updated
- Sep 24, 2024
- SHA
- 817d77b5
Try a prompt
Spaces
Model card
From the Hugging Face model README
Dummy GPT2 for TRL testing
from transformers import AutoTokenizer, GPT2Config, GPT2LMHeadModel
config = GPT2Config(n_positions=512, n_embd=32, n_layer=5, n_head=4, n_inner=37, pad_token_id=1023, is_decoder=True)
model = GPT2LMHeadModel(config)
tokenizer = AutoTokenizer.from_pretrained("openai-community/gpt2")
model_id = "trl-internal-testing/dummy-GPT2-correct-vocab"
model.push_to_hub(model_id)
tokenizer.chat_template = "{% for message in messages %}{% if message['role'] == 'user' %}{{ ' ' }}{% endif %}{{ message['content'] }}{% if not loop.last %}{{ ' ' }}{% endif %}{% endfor %}{{ eos_token }}"
tokenizer.push_to_hub(model_id)
config.push_to_hub(model_id)
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- Created
- Feb 8, 2023
- Updated
- Sep 24, 2024