Downloads · 30 days
13
20% of all-time downloads
guoch/bce-embedding-base_v1-openvino-qint8
bce-embedding-base_v1-openvino-qint8 is a machine learning model from guoch. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
OpenVINO Version 8bit of bce-embedding-basev1. Using: https://huggingface.co/spaces/sentence-transformers/backend-export. Calibrated using params: nyu-mll/glue, sst2, train, sentence, 300
Downloads · 30 days
13
20% of all-time downloads
All-time downloads
65
Public
Repo size
302 MB
Likes
0
Public
Click a slice to open those files.
.bin279 MB · 92%
From the Hugging Face model README
OpenVINO Version 8bit of bce-embedding-base_v1. Using: https://huggingface.co/spaces/sentence-transformers/backend-export. Calibrated using params: nyu-mll/glue, sst2, train, sentence, 300
from sentence_transformers import SentenceTransformer
# 1. Load the model from the Hugging Face Hub
model = SentenceTransformer(
"guoch/bce-embedding-base_v1-openvino-qint8",
backend="openvino",
model_kwargs={"file_name": "openvino_model_qint8_quantized.xml"},
)
# 2. Inference works as normal
embeddings = model.encode(["The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium."])
similarities = model.similarity(embeddings, embeddings)