Downloads · 30 days
84
1% of all-time downloads
dranger003/SFR-Embedding-Mistral-GGUF
SFR-Embedding-Mistral-GGUF is a sentence similarity model from dranger003. Use it when you need a score for how close two texts are. It is set up for gguf. The card lists the license as cc-by-nc-4.0.
GGUF quants for https://huggingface.co/Salesforce/SFR-Embedding-Mistral NOTE: This is a text embedding model used for feature extraction.
Downloads · 30 days
84
1% of all-time downloads
All-time downloads
12.8K
Public
Repo size
53.1 GB
Likes
15
Public
Click a slice to open those files.
.gguf26.5 GB · 100%
From the Hugging Face model README
GGUF quants for https://huggingface.co/Salesforce/SFR-Embedding-Mistral
NOTE: This is a text embedding model used for feature extraction.
As of Feb. 9, 2024 this model is no. 1 on the MTEB leaderboard.
https://huggingface.co/spaces/mteb/leaderboard
I have an example of how to use llama.cpp to generate embeddings for sentence similarity on my repo:
https://github.com/dranger003/llama.cpp-dotnet
| Layers | Context | Template |
|---|---|---|
| <pre>32</pre> | <pre>32768</pre> | <pre>Instruct: {task_description}<br>Query: {query}</pre> |