Downloads · 30 days
56
18% of all-time downloads
french-bge-m3-gguf
Fabcc/french-bge-m3-gguf
french-bge-m3-gguf is a feature extraction model from Fabcc. Use it when you need embeddings to search or compare text. It is set up for gguf. The card lists the license as mit.
This repository contains GGUF quantizations for antoinelouis/french-bge-m3, a French-pruned and optimized version of BAAI's bge-m3 model.
All-time downloads
303
Public
Repo size
1.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf1.6 GB · 100%
At a glance
- Task
- Feature Extraction
- Library
- gguf
- License
- mit
- Access
- Public
- Created
- Jul 23, 2026
- Updated
- Jul 23, 2026
- SHA
- 716077c6
Base models
Model card
From the Hugging Face model README
French BGE-M3 - GGUF
This repository contains GGUF quantizations for antoinelouis/french-bge-m3, a French-pruned and optimized version of BAAI's bge-m3 model.
Overview
- Original Architecture: BAAI/bge-m3
- French Pruned Version: antoinelouis/french-bge-m3
- Embedding Dimensions: 1024
- Context Length: 8,192 tokens
- Vocabulary Size: 37,200 tokens (pruned for French & Latin languages)
Files Included
| Filename | Quantization | Size | Recommended Use Case |
|---|---|---|---|
french-bge-m3-f16.gguf | F16 | ~700 MB | Full precision baseline |
french-bge-m3-q8_0.gguf | Q8_0 | ~360 MB | Recommended (99.9% quality, small footprint) |
french-bge-m3-q5_k_m.gguf | Q5_K_M | ~260 MB | Medium quantization |
french-bge-m3-q4_k_m.gguf | Q4_K_M | ~220 MB | Ultra lightweight |
Quick Start with llama.cpp
Local file execution:
llama-server -m french-bge-m3-q8_0.gguf --embedding --port 8080 -ngl 99
Direct loading via Hugging Face (-hf):
llama-server -hf "fabcc/french-bge-m3-GGUF:french-bge-m3-q8_0.gguf" --embedding --port 8080 -ngl 99
Test with OpenAI API Client (curl)
curl http://127.0.0.1:8080/v1/embeddings \
-H "Content-Type: application/json" \
-d '{
"input": "Ceci est un document de test en français.",
"model": "french-bge-m3"
}'
Credits & Attributions
- French Pruning & Optimization: Antoine Louis (antoinelouis/french-bge-m3)
- Original Model & Architecture: BAAI (BAAI/bge-m3)
- GGUF Conversion & Quantization: fabcc
- Task
- Feature Extraction
- Library
- gguf
- License
- mit
- Languages
- fr
- Created
- Jul 23, 2026
- Updated
- Jul 23, 2026