Brello-QAI-0.6B

Brello QAI 0.6B by Epic Systems

Brello QAI is a proprietary model created by Epic Systems. It is designed to deliver deep, targeted, and actionable responses rather than generic overviews. It supports both thinking and non-thinking modes.

• Strong reasoning via Qwen3 thinking tokens (<think>...</think>)
• Default Brello persona prioritizes specificity and actionable guidance
• Lightweight local inference on macOS (MPS), CUDA, or CPU

Quickstart

Local run with the included script:

python3 -m venv .venv
source .venv/bin/activate
pip install --upgrade pip
pip install -r requirements.txt
python run.py --prompt "Help me design a rollout plan for feature flags in a mobile app."

Options:

• --system: override the default Brello persona; pass empty string to disable
• --no-think: disable thinking mode
• --device: auto|mps|cuda|cpu

Example with a custom system message and non-thinking mode:

python run.py --no-think --system "You are Brello QAI. Give surgical, stepwise answers with tradeoffs." \
  --prompt "Compare blue/green and canary deployments for a small backend team."

Light SFT (optional)

To nudge the style further toward “deep and targeted,” see training/ for a LoRA SFT script and a small sample dataset. You can train a tiny adapter on your examples and then merge it into a standalone Brello checkpoint.

License

This repository includes open-source components under the Apache-2.0 license. See LICENSE for details.