Fara1.5-27B-GGUF

Fara1.5-27B - GGUF Quants & Multimodal Projectors

This repository contains GGUF quantizations and multimodal projector (mmproj) files for microsoft/Fara1.5-27B.

• Original Model: microsoft/Fara1.5-27B
• Developer: Microsoft Research AI Frontiers
• Base Architecture: Qwen3.5-27B (Multimodal Vision-Language / Computer Use Agent)
• Quantization Format: GGUF (Q3_K_M, Q4_K_M, Q4_K_S, Q5_K_M, Q5_K_S, Q6_K, Q8_0) + mmproj vision projectors

---

Repository Files

Model Weights (.gguf)

Multimodal Vision Projectors (.mmproj-*.gguf)

(Required to pass screenshot images into the model in llama.cpp)

---

Quickstart Guide

Because Fara1.5-27B processes screenshots, you must pass both a model weight file (-m) AND a multimodal projector file (--mmproj) during inference in llama.cpp.

1. Running with llama.cpp

# Clone and build llama.cpp
git clone [https://github.com/ggml-org/llama.cpp](https://github.com/ggml-org/llama.cpp)
cd llama.cpp && cmake -B build -DGGML_CUDA=ON && cmake --build build --config Release -j

# Download the model and vision projector from this repository
huggingface-cli download Abiray/Fara1.5-27B-GGUF Fara1.5-27B.Q4_K_M.gguf --local-dir .
huggingface-cli download Abiray/Fara1.5-27B-GGUF Fara1.5-27B.mmproj-f16.gguf --local-dir .

# Serve with llama-server
./build/bin/llama-server \
  -m Fara1.5-27B.Q4_K_M.gguf \
  --mmproj Fara1.5-27B.mmproj-f16.gguf \
  -ngl 99 \
  --port 8000 \
  -c 262144