Downloads · 30 days
654
1% of all-time downloads
gpt3-kor-small_based_on_gpt2
kykim/gpt3-kor-small_based_on_gpt2
gpt3-kor-small_based_on_gpt2 is a text generation model from kykim. Use it when you need the model to write or continue text. It is set up for transformers.
70GB Korean text dataset and 42000 lower-cased subwords are used Check the model performance and other language models for Korean in github
All-time downloads
102K
Public
Repo size
4.5 GB
Likes
12
Public
Repo makeup
Click a slice to open those files.
.bin526 MB · 36%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Jan 4, 2023
- SHA
- 7d3ce878
Model card
From the Hugging Face model README
Bert base model for Korean
- 70GB Korean text dataset and 42000 lower-cased subwords are used
- Check the model performance and other language models for Korean in github
from transformers import BertTokenizerFast, GPT2LMHeadModel
tokenizer_gpt3 = BertTokenizerFast.from_pretrained("kykim/gpt3-kor-small_based_on_gpt2")
input_ids = tokenizer_gpt3.encode("text to tokenize")[1:] # remove cls token
model_gpt3 = GPT2LMHeadModel.from_pretrained("kykim/gpt3-kor-small_based_on_gpt2")
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- Languages
- ko
- Created
- Mar 2, 2022
- Updated
- Jan 4, 2023