Downloads · 30 days
9
8% of all-time downloads
ellisdoro/EDAM-all-MiniLM-L6-v2_concat_gat_h1024_o64_cross_entropy_e256_aligned-on2vec-koji-early
EDAM-all-MiniLM-L6-v2_concat_gat_h1024_o64_cross_entropy_e256_aligned-on2vec-koji-early is a sentence similarity model from ellisdoro. Use it when you need a score for how close two texts are. It is set up for sentence-transformers. The card lists the license as apache-2.0.
This is a sentence-transformers model created with on2vec, which augments text embeddings with ontological knowledge using Graph Neural Networks.
Downloads · 30 days
9
8% of all-time downloads
All-time downloads
107
Public
Parameters
22.7M
121 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors90.9 MB · 75%
From the Hugging Face model README
This is a sentence-transformers model created with on2vec, which augments text embeddings with ontological knowledge using Graph Neural Networks.
This model uses a multi-stage architecture:
This model combines:
The ontological knowledge helps the model better understand domain-specific relationships and concepts.
from sentence_transformers import SentenceTransformer
# Load the model
model = SentenceTransformer('EDAM_all-MiniLM-L6-v2_concat_gat_h1024_o64_cross_entropy_e256_aligned')
# Generate embeddings
sentences = ['Example sentence 1', 'Example sentence 2']
embeddings = model.encode(sentences)
# Compute similarity
from sentence_transformers.util import cos_sim
similarity = cos_sim(embeddings[0], embeddings[1])
Simple concatenation of text and ontology embeddings
This model was created using the on2vec pipeline:
This model is particularly effective for:
If you use this model, please cite the on2vec framework:
@software{on2vec,
title={on2vec: Ontology Embeddings with Graph Neural Networks},
author={David Steinberg},
url={https://github.com/david4096/on2vec},
year={2024}
}
Created with on2vec 🧬→🤖