Virtuoso-Small-GGUF

QuantFactory/Virtuoso-Small-GGUF

This is quantized version of arcee-ai/Virtuoso-Small created using llama.cpp

Original Model Card

<div align="center"> <img src="https://i.ibb.co/pXD6Bcv/SW2-U-g-QQLSH1-ZAbxhs-Iu-A.webp" alt="Virtuoso-Small" style="border-radius: 10px; box-shadow: 0 4px 8px 0 rgba(0, 0, 0, 0.2), 0 6px 20px 0 rgba(0, 0, 0, 0.19); max-width: 100%; height: auto;"> </div>

GGUF Available Here

Virtuoso-Small

Virtuoso-Small is the debut public release of the Virtuoso series of models by Arcee.ai, designed to bring cutting-edge generative AI capabilities to organizations and developers in a compact, efficient form. With 14 billion parameters, Virtuoso-Small is an accessible entry point for high-quality instruction-following, complex reasoning, and business-oriented generative AI tasks. Its larger siblings, Virtuoso-Medium and Virtuoso-Large, offer even greater capabilities and are available via API at models.arcee.ai.

Key Features

• Compact and Efficient: With 14 billion parameters, Virtuoso-Small provides a high-performance solution optimized for smaller hardware configurations without sacrificing quality.
• Business-Oriented: Tailored for use cases such as customer support, content creation, and technical assistance, Virtuoso-Small meets the demands of modern enterprises.
• Scalable Ecosystem: Part of the Virtuoso series, Virtuoso-Small is fully interoperable with its larger siblings, Forte and Prime, enabling seamless scaling as your needs grow.

---

Deployment Options

Virtuoso-Small is available under the Apache-2.0 license and can be deployed locally or accessed through an API at models.arcee.ai. For larger-scale or more demanding applications, consider Virtuoso-Forte or Virtuoso-Prime.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here