Downloads · 30 days
16
7% of all-time downloads
nisavid/mxbai-rerank-large-v2-OptiQ-4bit
mxbai-rerank-large-v2-OptiQ-4bit is a text generation model from nisavid. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon (no PyTorch, no cloud). Try the Lab · All OptiQ quants · Docs
Downloads · 30 days
16
7% of all-time downloads
All-time downloads
215
Public
Parameters
1.5B
1.2 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors1.2 GB · 99%
How the weights are stored.
U321.5B · 100%
From the Hugging Face model README
Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon (no PyTorch, no cloud). Try the Lab · All OptiQ quants · Docs