Downloads · 30 days
14
0% of all-time downloads
AIFT-polyglot-ko-1.3b-ao-instruct-v0.91
mu0gum/AIFT-polyglot-ko-1.3b-ao-instruct-v0.91
AIFT-polyglot-ko-1.3b-ao-instruct-v0.91 is a text generation model from mu0gum. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
All-time downloads
18.1K
Public
Parameters
1.3B
5.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- gpt_neox
- Access
- Public
- Created
- Feb 8, 2024
- Updated
- Feb 14, 2024
- SHA
- a8c813a8
Try a prompt
Model card
From the Hugging Face model README
AIFT-polyglot-ko-1.3b-ao-instruct-v0.91
베이스 모델 : EleutherAI/polyglot-ko-1.3b
학습 데이터 : 자체 제작한 Open Orca 스타일 데이터셋 약 48,000건 (중복 제거 및 데이터 분포 조정)
학습 방법 : Full finetuning
epoch : 3
ko-lm-evaluation-harness(5-shot)
| kobest_boolq | kobest_copa | kobest_hellaswag | pawsx_ko |
|---|---|---|---|
| 0.5398860398860399 | 0.71 | 0.436 | 0.476 |
Framework versions
- Transformers 4.36.2
- Pytorch 2.1.2+cu121
- Datasets 2.0.0
- Tokenizers 0.15.0
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_neox
- License
- cc-by-nc-4.0
- Created
- Feb 8, 2024
- Updated
- Feb 14, 2024