Downloads · 30 days
0
padmanabh/mistralops-ministral-8b-agent-orchestrator
mistralops-ministral-8b-agent-orchestrator is a text generation model from padmanabh. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
Fine-tuned LoRA adapter for multi-step AI agent orchestration planning.
Downloads · 30 days
0
Access
Public
Updated Mar 1, 2026
Repo size
175 MB
Likes
0
Public
Click a slice to open those files.
.safetensors136 MB · 100%
From the Hugging Face model README
Fine-tuned LoRA adapter for multi-step AI agent orchestration planning.
This is a QLoRA adapter for Ministral-8B-Instruct-2410 fine-tuned to generate structured multi-step execution plans for AI agent orchestration.
Given a natural language user request, the model generates a JSON execution plan with:
| Parameter | Value |
|---|---|
| Base Model | Ministral-8B-Instruct-2410 (4-bit quantized) |
| Method | QLoRA (LoRA rank 8, alpha 16) |
| Framework | MLX on Apple Silicon M1 |
| Training Data | 1,500 synthetic examples (Mistral Large as teacher) |
| Peak Memory | 7.8 GB |
| Training Loss | 0.740 → 0.183 (75% reduction) |
| Training Iterations | 800 (v3 data, resumed from iter 200) |
| Metric | Base Model | Fine-Tuned | Improvement |
|---|---|---|---|
| Tool Selection Accuracy | 0.000 | 0.566 | +0.566 |
| Parameter Accuracy | 0.000 | 0.474 | +0.474 |
| Plan Completeness | 0.000 | 0.580 | +0.580 |
| Dependency Correctness | 0.000 | 0.900 | +0.900 |
| Error Recovery | 0.000 | 0.883 | +0.883 |
| Schema Validity | 0.000 | 0.817 | +0.817 |
The base model scores 0.000 across all metrics (wrong output schema — it doesn't know the plan format). Fine-tuning enables structured agent planning from scratch.
from mlx_lm import load, generate
from mlx_lm.sample_utils import make_sampler
model, tokenizer = load(
"mlx-community/Ministral-8B-Instruct-2410-4bit",
adapter_path="path/to/adapters"
)
sampler = make_sampler(temp=0.1)
messages = [
{"role": "system", "content": "You are an AI agent orchestrator. Generate a multi-step execution plan as JSON."},
{"role": "user", "content": "Check my emails, create tasks for action items, and send a summary to Slack"},
]
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
response = generate(model, tokenizer, prompt=prompt, max_tokens=2048, sampler=sampler)
Built for the Mistral AI Worldwide Hackathon — Tokyo Edition (Feb 28 - Mar 1, 2026).