Downloads · 30 days
2
7% of all-time downloads
ipc-llama3-8b-ins-lora-pretrain-merged
sde0119/ipc-llama3-8b-ins-lora-pretrain-merged
ipc-llama3-8b-ins-lora-pretrain-merged is a machine learning model from sde0119. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
- unsloth를 이용해 ipc pdf를 전처리/파싱한 raw data로 pretraining한 모델 - maxseqlength = 2000 -lorarank=64, loraalpha=64, loradropout=0
All-time downloads
27
Public
Parameters
8B
18.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors18.2 GB · 100%
Parameter types
How the weights are stored.
F167B · 87%
Base models
Model card
From the Hugging Face model README
-
unsloth를 이용해 ipc pdf를 전처리/파싱한 raw data로 pretraining한 모델
-
max_seq_length = 2000 -lora_rank=64, lora_alpha=64, lora_dropout=0
-
target_modules = ["q_proj", "k_proj", "v_proj", "o_proj",
-
"gate_proj", "up_proj", "down_proj", -
"lm_head", "embed_tokens",]
- Type
- llama
- Languages
- en
- Created
- Apr 8, 2025
- Updated
- Apr 8, 2025