Downloads · 30 days
167
0% of all-time downloads
taeminlee/kogpt2
kogpt2 is a text generation model from taeminlee. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
167
0% of all-time downloads
All-time downloads
150K
Public
Parameters
137M
1.5 GB on disk
Likes
2
Public
Click a slice to open those files.
.bin510 MB · 34%
How the weights are stored.
F32124M · 91%
From the Hugging Face model README
KoGPT2 on Huggingface Transformers
SKT-AI 에서 공개한 KoGPT2 (ver 1.0)를 Transformers에서 사용하도록 하였습니다.
SKT-AI 에서 KoGPT2 2.0을 공개하였습니다. https://huggingface.co/skt/kogpt2-base-v2/
from transformers import GPT2LMHeadModel, PreTrainedTokenizerFast
model = GPT2LMHeadModel.from_pretrained("taeminlee/kogpt2")
tokenizer = PreTrainedTokenizerFast.from_pretrained("taeminlee/kogpt2")
input_ids = tokenizer.encode("안녕", add_special_tokens=False, return_tensors="pt")
output_sequences = model.generate(input_ids=input_ids, do_sample=True, max_length=100, num_return_sequences=3)
for generated_sequence in output_sequences:
generated_sequence = generated_sequence.tolist()
print("GENERATED SEQUENCE : {0}".format(tokenizer.decode(generated_sequence, clean_up_tokenization_spaces=True)))