Solari-GGUF

Solari-GGUF

GGUF quantized version of Solari — a 500M parameter vision-language model fine-tuned for reduced hallucination on real-world images.

For full model details, training procedure, and benchmark analysis, see the Solari model card.

Model Details

• Base Model: Cubex11/Solari
• Original Base: SmolVLM2-500M-Video-Instruct
• Format: GGUF (for use with llama.cpp, Ollama, LM Studio, etc.)
• Fine-tuning Method: QLoRA + DPO on RLAIF-V (72K preference pairs)
• License: Apache-2.0

Benchmark Results

Solari improves on 7 out of 8 benchmarks vs the base model:

Note: Benchmarks were evaluated on the full-precision model. GGUF quantization may cause minor performance differences.

Usage

With llama.cpp

# Download the GGUF file
huggingface-cli download Cubex11/Solari-GGUF --local-dir ./solari-gguf

# Run inference
./llama-cli -m ./solari-gguf/Solari.gguf -p "Describe this image" --image your_image.jpg

With Ollama

# Create a Modelfile
echo 'FROM ./Solari.gguf' > Modelfile
ollama create solari -f Modelfile
ollama run solari

Links

• Full-precision model: Cubex11/Solari
• Training dataset: RLAIF-V
• Base model: SmolVLM2-500M-Video-Instruct

Citation

@misc{solari2026,
    title={Solari: Hallucination-Reduced Vision Language Model via QLoRA DPO on RLAIF-V},
    author={Cubex11},
    year={2026},
    url={https://huggingface.co/Cubex11/Solari}
}