Downloads · 30 days
101
8% of all-time downloads
all-MiniLM-L6-v2-GGUF
thlurte/all-MiniLM-L6-v2-GGUF
all-MiniLM-L6-v2-GGUF is a machine learning model from thlurte. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository contains GGUF format model files for sentence-transformers/all-MiniLM-L6-v2, generated with the intextus BERT GGUF conversion pipeline.
All-time downloads
1.3K
Public
Repo size
312 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf312 MB · 100%
At a glance
- Model type
- bert
- Access
- Public
- Created
- Jun 28, 2026
- Updated
- Jun 28, 2026
- SHA
- 21feecbb
Model card
From the Hugging Face model README
all-MiniLM-L6-v2-GGUF
This repository contains GGUF format model files for sentence-transformers/all-MiniLM-L6-v2, generated with the intextus BERT GGUF conversion pipeline.
These files are fully compatible with llama.cpp and intextus.
Available Files & Quantizations
all-MiniLM-L6-v2-F32.gguf: Full precision F32 (recommended for maximum accuracy and zero dequantization overhead on CPU).all-MiniLM-L6-v2-F16.gguf: Half precision F16.all-MiniLM-L6-v2-Q8_0.gguf: 8-bit quantization (recommended default, fast and near-lossless).all-MiniLM-L6-v2-Q6_K.gguf: 6-bit quantization.all-MiniLM-L6-v2-Q5_K_M.gguf: 5-bit quantization (Medium).all-MiniLM-L6-v2-Q5_0.gguf: 5-bit quantization.all-MiniLM-L6-v2-Q4_K_M.gguf: 4-bit quantization (Medium).all-MiniLM-L6-v2-Q4_0.gguf: 4-bit quantization.all-MiniLM-L6-v2-Q3_K_M.gguf: 3-bit quantization (Medium).all-MiniLM-L6-v2-Q2_K.gguf: 2-bit quantization.
- Type
- bert
- Created
- Jun 28, 2026
- Updated
- Jun 28, 2026