Downloads · 30 days
8
40% of all-time downloads
kkh27/healthcareLLM_v4
healthcareLLM_v4 is a machine learning model from kkh27. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
- Base Model: yanolja/EEVE-Korean-Instruct-10.8B-v1.0 - Model Size: 10.8B - Fine-tuned by: kkh27 - Training Framework: Hugging Face Transformers + PEFT (LoRA) - Precision: bfloat16 (bf16) - Language: Korean
Downloads · 30 days
8
40% of all-time downloads
All-time downloads
20
Public
Parameters
10.8B
21.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors21.6 GB · 100%
From the Hugging Face model README
yanolja/EEVE-Korean-Instruct-10.8B-v1.0| Parameter | Value |
|---|---|
Rank (r) | 16 |
| Alpha | 32 |
| Dropout | 0.05 |
| Bias | none |
| Task Type | CAUSAL_LM |
| Target Modules | q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj |
| Argument | Value |
|---|---|
| Per device train batch size | 8 |
| Gradient accumulation steps | 1 |
| Epochs | 3 |
| Learning rate | 5e-6 |
| Weight decay | 0.1 |