Downloads · 30 days
19
16% of all-time downloads
jina-reranker-v1-tiny-en-F16-GGUF
sinjab/jina-reranker-v1-tiny-en-F16-GGUF
jina-reranker-v1-tiny-en-F16-GGUF is a machine learning model from sinjab. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as apache-2.0.
This model was converted to GGUF format from jinaai/jina-reranker-v1-tiny-en using llama.cpp via the ggml.ai's GGUF-my-repo space.
All-time downloads
122
Public
Repo size
67.5 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf67.5 MB · 100%
At a glance
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- Oct 11, 2025
- Updated
- Oct 11, 2025
- SHA
- 9d06137b
Base models
Model card
From the Hugging Face model README
jina-reranker-v1-tiny-en-F16-GGUF
This model was converted to GGUF format from jinaai/jina-reranker-v1-tiny-en using llama.cpp via the ggml.ai's GGUF-my-repo space.
Refer to the original model card for more details on the model.
Model Information
- Base Model: jinaai/jina-reranker-v1-tiny-en
- Quantization: F16
- Format: GGUF (GPT-Generated Unified Format)
- Converted with: llama.cpp
Quantization Details
This is a F16 quantization of the original model:
- F16: Full 16-bit floating point - highest quality, largest size
- Q8_0: 8-bit quantization - high quality, good balance
- Q4_K_M: 4-bit quantization with medium quality - smaller size, faster inference
Usage
This model can be used with llama.cpp and other GGUF-compatible inference engines.
# Example using llama.cpp
./llama-rerank -m jina-reranker-v1-tiny-en-F16.gguf
Model Files
| Quantization | Use Case |
|---|---|
| F16 | Maximum quality, largest size |
| Q8_0 | High quality, good balance of size/performance |
| Q4_K_M | Good quality, smallest size, fastest inference |
Citation
If you use this model, please cite the original model:
# See original model card for citation information
License
This model inherits the license from the original model. Please refer to the original model card for license details.
Acknowledgements
- Original model by the authors of jinaai/jina-reranker-v1-tiny-en
- GGUF conversion via llama.cpp by ggml.ai
- Converted and uploaded by sinjab
- Library
- gguf
- License
- apache-2.0
- Languages
- en
- Created
- Oct 11, 2025
- Updated
- Oct 11, 2025