Downloads · 30 days
9
24% of all-time downloads
leobert
deliciouscat/leobert
leobert is a feature extraction model from deliciouscat. Use it when you need embeddings to search or compare text. It is set up for transformers.
This model is designed for the Leo language and is based on microsoft/codebert-base.
All-time downloads
37
Public
Parameters
125M
499 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors499 MB · 99%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- roberta
- Access
- Public
- Created
- Apr 5, 2024
- Updated
- Apr 11, 2024
- SHA
- 38482326
Model card
From the Hugging Face model README
This model is designed for the Leo language and is based on microsoft/codebert-base.
With the code data written in the Leo language crawled from GitHub, the model is trained using self-supervised learning with triplet loss.
Anchor and positive code chunks are from the same code, while negatives are not.
- Task
- Feature Extraction
- Library
- transformers
- Type
- roberta
- Created
- Apr 5, 2024
- Updated
- Apr 11, 2024