DistilSPhilBERTa

DistilSPhilBERTa

Latin and Ancient Greek cross-lingual sentence mining and similarity detection is a relatively new field.

In our paper Evaluating Latin and Ancient Greek Sentence Alignment through Parallel Sentence Mining we introduce DistilSPhilBERTa, a sentence-transformers model finetuned from bowphs/SPhilBerta for exactly these tasks. It achieves significantly better results in our custom sentence mining benchmark than SPhilBERTa and other classical cross-lingual language models. It maps sentences & paragraphs to a vector space and can be used for semantic textual similarity, semantic search, parallel sentence mining and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: bowphs/SPhilBerta <!-- at revision 5d0736d2df4063b862e186e7224e3066cd16ad2c -->
• Maximum Sequence Length: 128 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset: grosenthal/latin_english_parallel, English-Greek Dataset

Usage

Direct Usage (Sentence Transformers)

With the Sentence Transformers library installed, you can use the model in the following way:

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("sebastian-reichbauer/DistilSPhilBERTa")
# Run inference
sentences = [
    'Νομίζω οὖν τοῦτο καλὸν ὑπάρχειν διὰ τὴν ἐνεστῶσαν ἀνάγκην, ὅτι καλὸν ἀνθρώπῳ τὸ οὕτως εἶναι.'
]
embeddings = model.encode(sentences)
print(embeddings)