Downloads · 30 days
251
10% of all-time downloads
NbAiLab/borealis-4b-instruct-preview-gguf
borealis-4b-instruct-preview-gguf is a image-text-to-text model from NbAiLab. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as gemma.
Downloads · 30 days
251
10% of all-time downloads
All-time downloads
2.4K
Public
Repo size
34.9 GB
Likes
2
Public
Click a slice to open those files.
.gguf15.2 GB · 100%
From the Hugging Face model README
Release: Dec 22nd, 2025.
NbAiLab/borealis-4b-instruct-preview-gguf are quantized versions in GGUF format of a 4B-parameter instruction-tuned preview model intended for early testing and feedback. It is an experiment and should be treated as pre-release quality.
The original model is NbAiLab/borealis-4b-instruct-preview.
| Model | Bits | Format |
|---|---|---|
| NbAiLab/borealis-4b-instruct-preview | BF16 | Transformers (safetensors) |
| NbAiLab/borealis-4b-instruct-preview-gguf | 4 | GGUF (q4_K_M) |
| NbAiLab/borealis-4b-instruct-preview-gguf | 8 | GGUF (q8_0) |
| NbAiLab/borealis-4b-instruct-preview-gguf | BF16 | GGUF (bf16) |
| NbAiLab/borealis-4b-instruct-preview-mlx | 32 | MLX |
| NbAiLab/borealis-4b-instruct-preview-mlx-8bits | 8 | MLX (quantized) |