Downloads · 30 days
438
2% of all-time downloads
gec_kr
Soyoung97/gec_kr
gec_kr is a machine learning model from Soyoung97. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
All-time downloads
18K
Public
Repo size
2.5 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.bin496 MB · 100%
At a glance
- Library
- transformers
- Model type
- bart
- Access
- Public
- Created
- Oct 25, 2022
- Updated
- Jun 6, 2023
- SHA
- c4a70d9f
Model card
From the Hugging Face model README
Korean Grammatical Error Correction Model
maintainer: Soyoung Yoon
Official repository: link
Dataset request form: link
Demo: link
Colab demo: link
Sample code
import torch
from transformers import PreTrainedTokenizerFast
from transformers import BartForConditionalGeneration
tokenizer = PreTrainedTokenizerFast.from_pretrained('Soyoung97/gec_kr')
model = BartForConditionalGeneration.from_pretrained('Soyoung97/gec_kr')
text = '한국어는어렵다.'
raw_input_ids = tokenizer.encode(text)
input_ids = [tokenizer.bos_token_id] + raw_input_ids + [tokenizer.eos_token_id]
corrected_ids = model.generate(torch.tensor([input_ids]),
max_length=128,
eos_token_id=1, num_beams=4,
early_stopping=True, repetition_penalty=2.0)
output_text = tokenizer.decode(corrected_ids.squeeze().tolist(), skip_special_tokens=True)
output_text
>>> '한국어는 어렵다.'
Special thanks to the KoBART-summarization repository (referenced from it)
- Library
- transformers
- Type
- bart
- Created
- Oct 25, 2022
- Updated
- Jun 6, 2023