Vanguard-8B

<div align="center">

██╗   ██╗ █████╗ ███╗   ██╗ ██████╗ ██╗   ██╗ █████╗ ██████╗ ██████╗ 
██║   ██║██╔══██╗████╗  ██║██╔════╝ ██║   ██║██╔══██╗██╔══██╗██╔══██╗
██║   ██║███████║██╔██╗ ██║██║  ███╗██║   ██║███████║██████╔╝██║  ██║
╚██╗ ██╔╝██╔══██║██║╚██╗██║██║   ██║██║   ██║██╔══██║██╔══██╗██║  ██║
 ╚████╔╝ ██║  ██║██║ ╚████║╚██████╔╝╚██████╔╝██║  ██║██║  ██║██████╔╝
  ╚═══╝  ╚═╝  ╚═╝╚═╝  ╚═══╝ ╚═════╝  ╚═════╝ ╚═╝  ╚═╝╚═╝  ╚═╝╚═════╝ 
                      8B PARAMETERS | LOCAL A.I.

<h1>🚀 Vanguard-8B: The Ultimate Local Intelligence</h1> <h3><i>Forged for Developers. Perfected for Logic.</i></h3> <br> <img src="https://img.shields.io/badge/Parameters-7.6B-blue?style=for-the-badge" alt="Parameters"> <img src="https://img.shields.io/badge/Context-128K-green?style=for-the-badge" alt="Context Length"> <img src="https://img.shields.io/badge/License-Apache_2.0-red?style=for-the-badge" alt="License"> </div> <br>

Vanguard-8B-Merged is an elite, highly specialized linear fusion of three distinct neural networks. It solves the critical "Jack of all Trades" flaw found in standard 8B models by physically fusing the exact synaptic pathways of three absolute domain masters: a Conversational Engine, a Code Scaffolding Expert, and a Mathematical Logic Core.

Creator: Lakshan Muruganandam

---

🎯 Intended Uses & Limitations

Intended Use Cases:

• Local Code Generation: Writing Python, C++, Rust, and React scaffolds entirely offline.
• Mathematical Proofing: Breaking down complex logic puzzles step-by-step without hallucinating variables.
• Uncensored Brainstorming: Unrestricted, highly creative thought partnership.

Limitations & Out-of-Scope Uses:

• Like all LLMs under 10B parameters, it may occasionally hallucinate when asked hyper-niche trivia.
• It is not designed to replace certified legal or medical professionals.

---

🏆 The Vanguard Advantage: Benchmark Superiority

Generalist models like LLaMA 3 8B are excellent at conversation but suffer from severe Mathematical Fragility—if you change one variable or add complex multi-step logic, their chain-of-thought collapses. They also lack deep structural understanding of complex codebases.

Vanguard completely annihilates these weaknesses. By linearly injecting explicit weights from specialized Qwen 2.5 architecture, Vanguard bridges the gap between 8B parameter efficiency and 70B parameter logic.

Note: Vanguard sacrifices a fractional ~0.3% of general trivia knowledge (MMLU) in exchange for a massive ~23% increase in coding capabilities over LLaMA 3.

---

💻 Quickstart (Python Transformers)

If you are integrating Vanguard into an application via transformers, use the following snippet:

from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "LADDOO22212015/Vanguard-8B"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto")

prompt = "Write a python script to reverse a string."
messages = [
    {"role": "system", "content": "You are Vanguard, created by Lakshan Muruganandam."},
    {"role": "user", "content": prompt}
]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer([text], return_tensors="pt").to(model.device)

outputs = model.generate(**inputs, max_new_tokens=512, temperature=0.3)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

---

🧬 The Forge (Merge Configuration)

Vanguard is not a fine-tune; it is a structural architectural fusion. We used a strict Linear Merge using MergeKit to prevent the devastating tensor corruption (gibberish generation) associated with standard ties scaling.

merge_method: linear
models:
  - model: Qwen/Qwen2.5-7B-Instruct
    parameters:
      weight: 0.40
  - model: Qwen/Qwen2.5-Coder-7B-Instruct
    parameters:
      weight: 0.40
  - model: Qwen/Qwen2.5-Math-7B-Instruct
    parameters:
      weight: 0.20
dtype: bfloat16
tokenizer_source: base

---

📥 Getting Started & Downloads

This repository contains the Raw Uncompressed Weights (SafeTensors) designed for researchers, enterprise cloud deployment, or further fine-tuning.

🤗 Hugging Face Repositories

💡 New to local AI? Download the GGUF version — it runs on any modern laptop with 6GB+ RAM in under 2 minutes.

🗣️ Prompt Format (ChatML)

Vanguard uses strict ChatML formatting. When using local UIs, ensure your system uses this template:

<|im_start|>system
You are Vanguard, created by Lakshan Muruganandam. You are a helpful assistant.<|im_end|>
<|im_start|>user
Write a python script to reverse a string.<|im_end|>
<|im_start|>assistant

🛡️ The Identity Guarantee

Vanguard is completely unchained from corporate personalities. It has a hardcoded system persona deeply injected into the tokenizer_config.json, explicitly identifying as: "Vanguard, created by Lakshan Muruganandam."

---

License: Apache 2.0. Derived from the brilliant foundational work of the Alibaba Cloud Qwen Team.