Downloads · 30 days
114
12% of all-time downloads
bge-small-en-v1.5-GGUF
thlurte/bge-small-en-v1.5-GGUF
bge-small-en-v1.5-GGUF is a machine learning model from thlurte. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository contains GGUF format model files for BAAI/bge-small-en-v1.5, generated with llama.cpp's conversion tools.
All-time downloads
937
Public
Repo size
439 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf439 MB · 100%
At a glance
- Model type
- bert
- Access
- Public
- Created
- Jun 28, 2026
- Updated
- Jun 28, 2026
- SHA
- 5e0e1eab
Model card
From the Hugging Face model README
bge-small-en-v1.5-GGUF
This repository contains GGUF format model files for BAAI/bge-small-en-v1.5, generated with llama.cpp's conversion tools.
These files are fully compatible with llama.cpp and intextus.
Available Files & Quantizations
bge-small-en-v1.5-F32.gguf: Full precision F32.bge-small-en-v1.5-F16.gguf: Half precision F16.bge-small-en-v1.5-Q8_0.gguf: 8-bit quantization (recommended default, fast and near-lossless).bge-small-en-v1.5-Q6_K.gguf: 6-bit quantization.bge-small-en-v1.5-Q5_K_M.gguf: 5-bit quantization (Medium).bge-small-en-v1.5-Q5_0.gguf: 5-bit quantization.bge-small-en-v1.5-Q4_K_M.gguf: 4-bit quantization (Medium).bge-small-en-v1.5-Q4_0.gguf: 4-bit quantization.bge-small-en-v1.5-Q3_K_M.gguf: 3-bit quantization (Medium).bge-small-en-v1.5-Q2_K.gguf: 2-bit quantization.
- Type
- bert
- Created
- Jun 28, 2026
- Updated
- Jun 28, 2026