cuteadmoa-lora-adapter

CuttyMOA-1.0 LoRA Adapter

This is the LoRA adapter used to train CuttyMOA-1.0, the first self-trained model from the CUTEADMOA platform.

Training Details

• Base model: Qwen/Qwen2.5-14B-Instruct
• Method: QLoRA 4-bit (nf4, double quantization)
• LoRA config: r=128, α=256, dropout=0.05
• Target modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj (7 modules)
• Training steps: ~20,000 (RunPod A40 48GB)
• Dataset: sayeed105236/cuteadmoa-204-datasets (4.5M pairs, 24 categories)

Two-Phase Training

This adapter represents Phase 2 (20K steps on RunPod). Phase 1 (4K steps on HuggingFace) produced an earlier version of this adapter at commit a26500121. Both phases were TIES-merged into the final CuttyMOA-1.0 model.

Usage

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-14B-Instruct", torch_dtype="float16")
model = PeftModel.from_pretrained(base, "sayeed105236/cuteadmoa-lora-adapter")
model = model.merge_and_unload()

📄 Publication

This model is part of the CUTEADMOA platform presented in:

Md Abu Sayeed. CUTEADMOA: A Unified Mixture-of-Agents Platform with Continuous Self-Training for Autonomous Enterprise AI Automation. Advances in Artificial Intelligence and Robotics Research, Vol. 2, No. 3, pp. 190–208, September 2026.

• 📰 Paper page: https://www.scirp.org/journal/paperinformation?paperid=154162
• 📄 Full-text PDF: https://www.scirp.net/pdf/airr_2970152.pdf
• 🔗 DOI: https://doi.org/10.4236/airr.2026.23011

@article{sayeed2026cuteadmoa,
  author  = {Md Abu Sayeed},
  title   = {CUTEADMOA: A Unified Mixture-of-Agents Platform with Continuous Self-Training for Autonomous Enterprise AI Automation},
  journal = {Advances in Artificial Intelligence and Robotics Research},
  volume  = {2},
  number  = {3},
  pages   = {190--208},
  year    = {2026},
  issn    = {3143-3987},
  doi     = {10.4236/airr.2026.23011},
  url     = {https://www.scirp.org/journal/paperinformation?paperid=154162}
}