Downloads · 30 days
11
1% of all-time downloads
poly-ko-1.3b-translate
aeolian83/poly-ko-1.3b-translate
poly-ko-1.3b-translate is a text generation model from aeolian83. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- EleutherAI/polyglot-ko-1.3b을 squarelike/sharegptdeeplkotranslation으로 영한 번역만 가능하도록 fine-tuning한 모델 - QRoLA기법으로 fine-tunnig
All-time downloads
1.8K
Public
Repo size
5.3 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin2.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- gpt_neox
- Access
- Public
- Created
- Aug 12, 2023
- Updated
- Aug 13, 2023
- SHA
- 6a99cce4
Model card
From the Hugging Face model README
poly-ko-1.3b-translate
- EleutherAI/polyglot-ko-1.3b을 squarelike/sharegpt_deepl_ko_translation으로 영한 번역만 가능하도록 fine-tuning한 모델
- QRoLA기법으로 fine-tunnig
훈련 정보
- Epoch: 1
- learning-rate: 3e-4
- batch_size: 3
- Lora r: 8
- Lora target modules: query_key_value
3090GPU 1대로 훈련했습니다.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_neox
- License
- apache-2.0
- Languages
- ko
- Created
- Aug 12, 2023
- Updated
- Aug 13, 2023