Dispatch-7B-LoRA

Dispatch-7B — LoRA adapter 🚦

QLoRA adapter (r=16, attention + MLP projections) for Dispatch-7B, an agent orchestrator built on Mistral 7B Instruct v0.3 that routes agentic work: request + tool catalog in → JSON execution plan out. 97.4% valid-plan rate on held-out tasks — full evaluation, usage, and prompt format on the main model card.

Use this repo to:

• Continue fine-tuning on your own domain's tools (load with Unsloth or PEFT and resume training on your data — the training pipeline is documented on the main card)
• Serve base + adapter separately (e.g., vLLM LoRA serving, or hot-swapping adapters over one shared base model)

For plain inference, prefer the merged weights or the GGUF quants.

from unsloth import FastLanguageModel

model, tokenizer = FastLanguageModel.from_pretrained(
    "hvss/Dispatch-7B-LoRA", max_seq_length=3072, load_in_4bit=True,
)

License: Apache 2.0.