Downloads · 30 days
4
0% of all-time downloads
AIFT-42dot-LLM-PLM-1.3B-instruct-slim-v1.5
mu0gum/AIFT-42dot-LLM-PLM-1.3B-instruct-slim-v1.5
AIFT-42dot-LLM-PLM-1.3B-instruct-slim-v1.5 is a text generation model from mu0gum. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
All-time downloads
42.4K
Public
Parameters
1.4B
2.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- llama
- Access
- Public
- Created
- Jan 15, 2024
- Updated
- Jan 15, 2024
- SHA
- 4e2d01b6
Try a prompt
Model card
From the Hugging Face model README
AIFT-42dot-LLM-PLM-1.3B-instruct-slim-v1.5
베이스 모델 : 42dot/42dot_LLM-PLM-1.3B
학습 데이터 : 자체 제작한 instruction 데이터셋 약 60,000건
학습 방법 : Lora
Lora Config
- lora_alpha: 16
- lora_dropout: 0.05,
- r: 8
ko-lm-evaluation-harness(0-shot)
| kobest_boolq | kobest_copa | kobest_hellaswag | kobest_sentineg | kohatespeech | kohatespeech_apeach | kohatespeech_gen_bias | korunsmile | nsmc | pawsx_ko |
|---|---|---|---|---|---|---|---|---|---|
| 0.4843304843304843 | 0.688 | 0.444 | 0.7229219143576826 | 0.3057324840764331 | 0.4586206896551724 | 0.40764331210191085 | 0.3758328354743747 | 0.66632 | 0.5445 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-nc-4.0
- Created
- Jan 15, 2024
- Updated
- Jan 15, 2024