Downloads · 30 days
238
9% of all-time downloads
BAAI-bge-m3-int8
libryo-ai/BAAI-bge-m3-int8
BAAI-bge-m3-int8 is a feature extraction model from libryo-ai. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
Converted BAAI/bge-m3 model (dense retriever only) in onnx int8 format for use with Vespa Embedding.
All-time downloads
2.8K
Public
Repo size
587 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.onnx570 MB · 97%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- License
- mit
- Model type
- xlm-roberta
- Access
- Public
- Created
- Jun 11, 2024
- Updated
- Jun 11, 2024
- SHA
- 7698c0c3
Model card
From the Hugging Face model README
Converted BAAI/bge-m3 model (dense retriever only) in onnx int8 format for use with Vespa Embedding.
- BAAI-bge-m3_quantized.onnx (int8 quantized)
The model was quantized using the optimum toolkit.
Tips: conver to int8 quantized
# https://github.com/vespa-engine/sample-apps/blob/master/simple-semantic-search/export_hf_model_from_hf.py
./export_hf_model_from_hf.py --hf_model BAAI/bge-m3 --output_dir bge-m3
optimum-cli onnxruntime quantize --onnx_model ./bge-m3 -o bge-m3-large_quantized --avx512_vnni
License
The license for this model is based on the original license (found in the LICENSE file in the project's root directory), which is the MIT License.
Attribution
All credits for this model go to the authors of BAAI/bge-m3 and the associated researchers and organizations. When using this model, please be sure to attribute the original authors.
- Task
- Feature Extraction
- Library
- transformers
- Type
- xlm-roberta
- License
- mit
- Created
- Jun 11, 2024
- Updated
- Jun 11, 2024