Downloads · 30 days
0
hayulalab/swarm-of-specialists-paper
swarm-of-specialists-paper is a machine learning model from hayulalab. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Downloads · 30 days
0
Access
Public
Updated Jul 8, 2026
Repo size
—
Likes
0
Public
Click a slice to open those files.
.md14.9 KB · 100%
From the Hugging Face model README
Hayula AI Lab
The dominant paradigm in large language model deployment favors monolithic architectures: single large models (70B–400B+ parameters) trained on diverse data and tasked with general-purpose reasoning. This paper presents an alternative approach developed at Hayula Labs: ensembles of fine-tuned 7-8B parameter specialist models, each optimized for a narrow domain, coordinated by a lightweight routing layer.
| File | Description |
|---|---|
paper.md | Full paper (Markdown) |
README.md | This model card |
@techreport{hayulalab2026swarmofspecialists,
title={Swarm of Specialists: Can Multi-Model Ensembles of Fine-Tuned 7-8B Specialists Surpass Monolithic 70B+ Foundation Models? — Hayula Research},
author={Hayula AI Lab},
year={2026},
url={https://huggingface.co/hayulalab/swarm-of-specialists-paper}
}
hayulalab — Open Source AI Research