Downloads · 30 days
2
3% of all-time downloads
AIFT-42dot-LLM-PLM-1.3B-ao-instruct-all-v0.2
mu0gum/AIFT-42dot-LLM-PLM-1.3B-ao-instruct-all-v0.2
AIFT-42dot-LLM-PLM-1.3B-ao-instruct-all-v0.2 is a text generation model from mu0gum. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
All-time downloads
70
Public
Parameters
1.4B
5.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- llama
- Access
- Public
- Created
- Jan 16, 2024
- Updated
- Jan 16, 2024
- SHA
- 7e755b11
Try a prompt
Model card
From the Hugging Face model README
AIFT-42dot-LLM-PLM-1.3B-ao-instruct-all-v0.2
베이스 모델 : 42dot/42dot_LLM-PLM-1.3B
학습 데이터 : 자체 제작한 Open Orca 스타일 데이터셋 약 26,000건
학습 방법 : Lora
Lora Config
- lora_alpha: 16
- lora_dropout: 0.05,
- r: 8
ko-lm-evaluation-harness(0-shot)
| kobest_boolq | kobest_copa | kobest_hellaswag | kobest_sentineg | kohatespeech | kohatespeech_apeach | kohatespeech_gen_bias | korunsmile | nsmc | pawsx_ko |
|---|---|---|---|---|---|---|---|---|---|
| 0.5014245014245015 | 0.702 | 0.434 | 0.6876574307304786 | 0.2951167728237792 | 0.5106100795755968 | 0.14225053078556263 | 0.3627087567466955 | 0.60714 | 0.5265 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-nc-4.0
- Created
- Jan 16, 2024
- Updated
- Jan 16, 2024