Downloads · 30 days
37
15% of all-time downloads
yasserrmd/Neuro-Orchestrator-8B
Neuro-Orchestrator-8B is a text generation model from yasserrmd. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
37
15% of all-time downloads
All-time downloads
246
Public
Parameters
8.2B
16.4 GB on disk
Likes
3
Public
Click a slice to open those files.
.safetensors16.4 GB · 100%
From the Hugging Face model README
The Autonomous Adaptive Research Engine
Logic of HiPO + Structure of Nemotron + Skills of MiroThinker
Neuro-Orchestrator-8B is a state-of-the-art agentic merge built on the Qwen architecture. It is designed to solve the "always-on" reasoning problem by utilizing a hybrid gating mechanism derived from merging three distinct Qwen-based fine-tunes:
It was created using the TIES-Merging method on the following base models:
miromind-ai/MiroThinker-v1.0-8B (Code, Logic, Tool Use)nvidia/Nemotron-Orchestrator-8B (Planning, Structure)Kwaipilot/HiPO-8B (Reasoning Gating, Efficiency)This model is optimized to run in bfloat16 precision. It uses the specific ChatML prompt template native to Qwen models.
pip install torch transformers accelerate
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
# --- CONFIGURATION ---
MODEL_PATH = "yasserrmd/Neuro-Orchestrator-8B"
# Load Tokenizer & Model
tokenizer = AutoTokenizer.from_pretrained(MODEL_PATH)
model = AutoModelForCausalLM.from_pretrained(
MODEL_PATH,
torch_dtype=torch.bfloat16,
device_map="auto",
trust_remote_code=True
)
print("Model loaded successfully!")
# --- INFERENCE FUNCTION ---
def run_neuro_agent(prompt):
# Qwen/ChatML Format triggers the Orchestrator personality
full_prompt = (
f"<|im_start|>system\n"
f"You are Neuro-Orchestrator. Analyze the request complexity, plan, and execute.<|im_end|>\n"
f"<|im_start|>user\n"
f"{prompt}<|im_end|>\n"
f"<|im_start|>assistant\n"
)
inputs = tokenizer(full_prompt, return_tensors="pt").to("cuda")
with torch.no_grad():
outputs = model.generate(
**inputs,
max_new_tokens=400,
do_sample=True,
temperature=0.6,
repetition_penalty=1.15,
pad_token_id=tokenizer.eos_token_id
)
response = tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True)
return response
# --- EXAMPLE USAGE ---
print(run_neuro_agent("Plan a 3-day trip to Tokyo for a couple with a $2000 budget."))
The following examples demonstrate the Elastic Reasoning capability: the model is concise on simple tasks but structured and deep on complex tasks.
The model breaks down complex requests into phased execution plans.
<details> <summary><b>Example: 4-Week YouTube Launch Plan</b></summary>Prompt: "I want to start a YouTube channel about cooking. Create a 4-week launch roadmap."
Response:
The user wants a structured plan for launching a cooking YouTube channel...
<think>
...For Week 1 focus on setup essentials... Week 2 shifts to refining... Week 3 is critical...
</think>
Launch Roadmap:
Generates functional, clean code with correct imports.
<details> <summary><b>Example: Python Image Resizing</b></summary>Prompt: "Write a Python script that resizes all images in a folder to 50% dimensions using Pillow."
Response:
from PIL import Image
import os
def resize_images(input_folder):
# Ensure the input folder exists
if not os.path.exists(input_folder):
print(f"The folder {input_folder} does not exist.")
return
# List all files in the input folder
files = os.listdir(input_folder)
# Process each file
for filename in files:
file_path = os.path.join(input_folder, filename)
# Check if file is an image
if os.path.isfile(file_path) and filename.lower().endswith(('.png', '.jpg', '.jpeg')):
with Image.open(file_path) as img:
# Calculate new dimensions
new_width = int(img.width * 0.5)
new_height = int(img.height * 0.5)
# Resize and save
resized_img = img.resize((new_width, new_height))
resized_img.save(file_path)
</details>
Detects simple queries and skips unnecessary reasoning.
<details> <summary><b>Example: Fact Retrieval</b></summary>Prompt: "What is the capital of Australia?"
Response: The user's query asks for a straightforward factual answer... This task doesn't demand complex thought.
Answer: The capital of Australia is Canberra.
</details>Handles trick questions by analyzing the premise.
<details> <summary><b>Example: The Lead vs. Feathers Trap</b></summary>Prompt: "Which is heavier: a pound of feathers or a pound of lead? Explain why people get this wrong."
Response: Both a pound of feathers and a pound of lead weigh exactly the same... However, many people might think that a pound of lead is heavier due to a misconception related to density and volume. Lead is much denser, so it occupies less volume, leading to the intuitive bias that "small and heavy" equals "heavier."
</details>This model is a merge of Qwen-based models. Users should comply with the Apache 2.0 license and the specific terms of the constituent models: