Downloads · 30 days
16
2% of all-time downloads
kf-deberta-base-cross-sts
deliciouscat/kf-deberta-base-cross-sts
kf-deberta-base-cross-sts is a sentence similarity model from deliciouscat. Use it when you need a score for how close two texts are. It is set up for transformers. The card lists the license as mit.
pre-trained model: KF-DeBERTa-base-cross-NLI (https://huggingface.co/deliciouscat/kf-deberta-base-cross-nli)
All-time downloads
1K
Public
Parameters
186M
744 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors744 MB · 99%
At a glance
- Task
- Sentence Similarity
- Library
- transformers
- License
- mit
- Model type
- deberta-v2
- Access
- Public
- Created
- Mar 10, 2024
- Updated
- Jul 8, 2024
- SHA
- 5165f817
Datasets
Model card
From the Hugging Face model README
KF-DeBERTa-base-cross-STS
pre-trained model: KF-DeBERTa-base-cross-NLI (https://huggingface.co/deliciouscat/kf-deberta-base-cross-nli)
trained data:
klue/sts: 1epochdkoterwa/kor-sts: 2epoch
label scaling: 0~5 -> -1->1
bi-encoder STS 학습을 위한 dataset augmentation을 상정하고 훈련하였습니다. (https://arxiv.org/abs/2010.08240)
cosine similarity로 학습할 수 있도록 scaling 된 output이 추론됩니다.
- Task
- Sentence Similarity
- Library
- transformers
- Type
- deberta-v2
- License
- mit
- Languages
- ko
- Created
- Mar 10, 2024
- Updated
- Jul 8, 2024