Downloads · 30 days
140
13% of all-time downloads
borealis-12b-instruct-preview-gguf
NbAiLab/borealis-12b-instruct-preview-gguf
borealis-12b-instruct-preview-gguf is a image-text-to-text model from NbAiLab. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as gemma.
Model creator: NbAiLab<br/ Original model: NbAiLab/borealis-12b-instruct-preview<br/ GGUF quantization: provided by NbAiLab using llama.cpp<br/
All-time downloads
1.1K
Public
Repo size
47.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf47.9 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- Library
- transformers
- License
- gemma
- Access
- Public
- Created
- Feb 20, 2026
- Updated
- Mar 2, 2026
- SHA
- a59f8262
Base models
Datasets
Model card
From the Hugging Face model README
borealis-12b-instruct-preview
Model creator: NbAiLab<br/>
Original model: NbAiLab/borealis-12b-instruct-preview<br/>
GGUF quantization: provided by NbAiLab using llama.cpp<br/>
Available Quantizations
- Q4_K_M
- Q8_0
- BF16
Special thanks
🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.
Usage Examples
Q4_K_M
Ollama:
ollama run "hf.co/NbAiLab/borealis-12b-instruct-preview-gguf:Q4_K_M"
LM Studio:
lms load "NbAiLab/borealis-12b-instruct-preview-gguf/borealis-12b-instruct-preview-Q4_K_M.gguf"
llama.cpp CLI:
llama-cli --hf "NbAiLab/borealis-12b-instruct-preview-gguf:Q4_K_M" -p "The meaning to life and the universe is"
llama.cpp Server:
llama-server --hf "NbAiLab/borealis-12b-instruct-preview-gguf:Q4_K_M" -c 4096
Q8_0
Ollama:
ollama run "hf.co/NbAiLab/borealis-12b-instruct-preview-gguf:Q8_0"
LM Studio:
lms load "NbAiLab/borealis-12b-instruct-preview-gguf/borealis-12b-instruct-preview-Q8_0.gguf"
llama.cpp CLI:
llama-cli --hf "NbAiLab/borealis-12b-instruct-preview-gguf:Q8_0" -p "The meaning to life and the universe is"
llama.cpp Server:
llama-server --hf "NbAiLab/borealis-12b-instruct-preview-gguf:Q8_0" -c 4096
BF16
Ollama:
ollama run "hf.co/NbAiLab/borealis-12b-instruct-preview-gguf:BF16"
LM Studio:
lms load "NbAiLab/borealis-12b-instruct-preview-gguf/borealis-12b-instruct-preview-BF16.gguf"
llama.cpp CLI:
llama-cli --hf "NbAiLab/borealis-12b-instruct-preview-gguf:BF16" -p "The meaning to life and the universe is"
llama.cpp Server:
llama-server --hf "NbAiLab/borealis-12b-instruct-preview-gguf:BF16" -c 4096
- Task
- Image-Text-to-Text
- Library
- transformers
- License
- gemma
- Languages
- no, nb, nn
- Created
- Feb 20, 2026
- Updated
- Mar 2, 2026