Downloads · 30 days
11
24% of all-time downloads
TAPAS-KCBERT-slerp2
H-du-kang/TAPAS-KCBERT-slerp2
TAPAS-KCBERT-slerp2 is a fill-mask model from H-du-kang. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
TAPAS-KCBERT-slerp2 is a merge of the following models using mergekit: beomi/kcbert-base beomi/kcbert-base
All-time downloads
45
Public
Parameters
132M
264 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors264 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- apache-2.0
- Model type
- bert
- Access
- Public
- Created
- May 28, 2024
- Updated
- May 28, 2024
- SHA
- f2a830e5
Try a prompt
Model card
From the Hugging Face model README
TAPAS-KCBERT-slerp2
TAPAS-KCBERT-slerp2 is a merge of the following models using mergekit:
🧩 Configuration
slices:
- sources:
- model: beomi/kcbert-base
layer_range: [0, 12] # TAPAS 모델의 레이어 범위
- model: beomi/kcbert-base
layer_range: [0, 12] # KCBERT 모델의 레이어 범위
merge_method: slerp
base_model: beomi/kcbert-base
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: bfloat16
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- apache-2.0
- Created
- May 28, 2024
- Updated
- May 28, 2024