Downloads · 30 days
4
6% of all-time downloads
AIFT-42dot-LLM-PLM-ao-instruct-all-v0.3
mu0gum/AIFT-42dot-LLM-PLM-ao-instruct-all-v0.3
AIFT-42dot-LLM-PLM-ao-instruct-all-v0.3 is a text generation model from mu0gum. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
All-time downloads
66
Public
Parameters
1.4B
2.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- llama
- Access
- Public
- Created
- Jan 16, 2024
- Updated
- Jan 16, 2024
- SHA
- 2152dcc9
Try a prompt
Model card
From the Hugging Face model README
AIFT-42dot-LLM-PLM-1.3B-ao-instruct-all-v0.3
베이스 모델 : 42dot/42dot_LLM-PLM-1.3B
학습 데이터 : 자체 제작한 Open Orca 스타일 데이터셋 약 29,000건
학습 방법 : Lora
Lora Config
- lora_alpha: 16
- lora_dropout: 0.05,
- r: 8
ko-lm-evaluation-harness(0-shot)
| kobest_boolq | kobest_copa | kobest_hellaswag | kobest_sentineg | kohatespeech | kohatespeech_apeach | kohatespeech_gen_bias | korunsmile | nsmc | pawsx_ko |
|---|---|---|---|---|---|---|---|---|---|
| 0.5021367521367521 | 0.704 | 0.438 | 0.7732997481108312 | 0.3099787685774947 | 0.5098143236074271 | 0.14225053078556263 | 0.36599467230730043 | 0.6495 | 0.529 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-nc-4.0
- Created
- Jan 16, 2024
- Updated
- Jan 16, 2024