Treebeard-Qwen3.6-35B-A3B-GGUF

Treebeard

Linux package for Qwen3.6-35B-A3B: one Q5_K_XL GGUF (~26.6 GB), optional F16 vision projector, Qwen tokenizer/metadata, platform runtimes (portable CPU, Intel SYCL, NVIDIA CUDA), installer, and local llama-server with /v1/chat/completions on loopback by default.

Package line on the card: release 0.1.1 / runtime 0.1.0-rc.3 (launcher pkg4) unless a newer archive is listed in this repo. Weights are commodity open Qwen GGUF; this repo is packaging + runtime evidence.

Site (evidence tables): https://newjordan.github.io/treebeard/
GitHub: https://github.com/newjordan/treebeard

Install on Linux

About 26.7 GB download (resumable). Installer checks file SHA-256. Roughly 32 GB system or unified memory.

curl -fsSL https://raw.githubusercontent.com/newjordan/treebeard/main/install.sh | bash
~/.local/bin/treebeard doctor
~/.local/bin/treebeard serve

curl http://127.0.0.1:8093/health

curl http://127.0.0.1:8093/v1/chat/completions \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "treebeard",
    "messages": [{"role": "user", "content": "Write a haiku about old forests."}],
    "max_tokens": 96,
    "chat_template_kwargs": {"enable_thinking": false}
  }'

Vision projector (+0.9 GB):

curl -fsSL https://raw.githubusercontent.com/newjordan/treebeard/main/install.sh | \
  bash -s -- --multimodal

Useful installer flags: --backend, --install-dir, --bin-dir, --allow-low-memory.

Platforms

NVIDIA GPU acceleration in this package line is the ARM64 GB10 path. x86_64 NVIDIA hosts use the portable CPU runtime unless a later package adds a CUDA x86 build.

Agent Bench freeze (named run)

Report UI: https://newjordan.github.io/treebeard/
This is a checksum-pinned freeze for a named package/runtime. It is the score in those result files, not a guarantee for every local install or quant.

Control A/B (2026-07-28, stock Q5, Arc Pro B70)

Clean upstream SYCL binary versus Treebeard package binary + package env. Same weights: Q5_K_XL sha256 25233af7642e3a91bd52cc4aeefdbd4a117479088e06cf1aea5b6bedb443c506.

Multi-slot p50 is concurrent capacity. Sequential tg is single-stream. Full notes: RELEASE-20260728.md.

Other measurements

CPU numbers are smoke at 4,096 context, not a cross-hardware promise. Detail and scope: docs/BENCHMARKS.md.

Commands

treebeard serve       # default: start local API
treebeard doctor      # platform selection + launch command
treebeard verify      # verify installed files
treebeard status      # health endpoint
treebeard report      # public report URL
treebeard help

Default GPU quality profile: 1 slot, 262144 context (shape used for the freeze). Throughput profile: 12 slots (serving saturation). Reasoning defaults off. TREEBEARD_SPECULATION is opt-in; no speed claim attached on this card.

TREEBEARD_CONTEXT=8192 TREEBEARD_PORT=8080 treebeard serve
TREEBEARD_PROFILE=throughput treebeard serve
TREEBEARD_MULTIMODAL=1 TREEBEARD_CONTEXT=32768 treebeard serve

Full package layout

This HF repo is the package (Git LFS for the GGUF). After clone/download:

bash ./verify.sh
bash ./treebeard doctor
bash ./treebeard serve

Contents include the Q5 GGUF, optional mmproj-F16.gguf, tokenizer/config, CPU/SYCL/CUDA runtime archives, install.sh / treebeard / run.sh, profiles, SHA256SUMS, and evidence under evidence/. See docs/PACKAGE.md.

Provenance (package pin)

• Integration commit (package line): 6a6dc2def952fe5e9b2da81e638968653b6be3db
• Release baseline: 3799687213eddbdc1389994f110fac0fa01f3e36
• NVIDIA patch SHA-256: c1e0780c96432059ea7a517f6ab2db935f1083da065ed0a9009a00d944c3415f
• Base model: Qwen/Qwen3.6-35B-A3B metadata revision 995ad96e
• GGUF source: unsloth/Qwen3.6-35B-A3B-GGUF revision a483e9e6

Security and license

API binds to loopback by default. Non-loopback bind is an unauthenticated inference surface unless you add TLS auth and firewall rules.

Model/tokenizer: Apache-2.0. llama.cpp-derived runtimes: MIT. See LICENSE, LICENSE-RUNTIME, NOTICE.md. Unofficial packaging; not an official Qwen, Unsloth, NVIDIA, Intel, Hugging Face, or llama.cpp product.