antares-gguf-community

Antraes-1B (GGUF)

Community GGUF quantizations of Cisco's Antares-1B — an open-weight 1-billion parameter language model specialized for vulnerability localization in real-world codebases. Built on IBM Granite 4.0 1B, it autonomously navigates source code repositories through a terminal interface using a two-stage SFT + GRPO pipeline.

These GGUF files enable running Antares-1B locally with llama.cpp, LM Studio, Ollama, Jan, Open WebUI, and other GGUF-compatible inference engines.

Model Details

Performance

On the Vulnerability Localization Benchmark (VLoc Bench, 500 tasks), Antares-1B achieves a File F1 of 0.209, outperforming models many times its size including GLM-5.2, Gemini 3 Pro, GPT-5 Mini, and Qwen3.5-122B.

Files

Usage

llama.cpp

# Build or download llama.cpp, then run:
./llama-cli -m antraes-1b-f16.gguf \
  --temp 0.3 \
  --top-p 1.0 \
  --ctx-size 8192 \
  -p "<|start_of_role|>system<|end_of_role|>You are a security vulnerability localization agent...<|end_of_text|>\n<|start_of_role|>user<|end_of_role|>Vulnerability to locate:\nCWE-78: OS Command Injection<|end_of_text|>\n<|start_of_role|>assistant<|end_of_role|><think>"

LM Studio

1. Download antraes-1b-f16.gguf
2. Open LM Studio → drag the .gguf file into the model directory
3. Select "Antraes-1B" from the model dropdown
4. This model uses the Granite chat template (auto-detected)

Ollama

# Create a Modelfile:
FROM ./antraes-1b-f16.gguf
TEMPLATE """{{ .System }}

{{ .Prompt }}"""

# Then:
ollama create antraes-1b -f Modelfile
ollama run antraes-1b

Jan

1. Download antraes-1b-f16.gguf
2. Open Jan → Settings → Extensions → enable "GGUF Engine"
3. Drag the .gguf file into Jan's model folder
4. The model will appear in your model list

Open WebUI

If using Ollama as the backend, pull the model into Ollama first (see above), then it will be available in Open WebUI.

Prompt Format

The model uses a structured tool-calling format with special tokens:

<|start_of_role|>system<|end_of_role|>...<|end_of_text|>
<|start_of_role|>user<|end_of_role|>...<|end_of_text|>
<|start_of_role|>assistant<|end_of_role|><think>...reasoning...</think>
<tool_call>{"name": "terminal", "arguments": {"command": "..."}}</tool_call>
<|end_of_text|>
<|start_of_role|>user<|end_of_role|>
<tool_response>...output...</tool_response>
<|end_of_text|>
<|start_of_role|>assistant<|end_of_role|><think>...

The agent loop terminates when the model calls submit_vulnerable_files or submit_no_vulnerability_found.

Intended Use

• Vulnerability Localization: Given a CWE identifier and a repository, identifying which source files contain the reported vulnerability using only a terminal interface
• Shift-Left Security: Integrating into CI/CD pipelines for early vulnerability detection
• Advisory-Driven Triage: Using CWE identifiers mapped from CVE/GHSA records to guide repository exploration

See the original model card for full details on intended/out-of-scope use, limitations, safety, and evaluation methodology.

Disclaimer

This is an unofficial community GGUF conversion of Cisco's Antares-1B model. These files are not affiliated with or endorsed by Cisco Systems, Inc. The original model is licensed under Apache 2.0 by Cisco Systems, Inc.