CWC-Mistral-Nemo-12B-V2-q4_k_m

Model created by non-profit CWC (Consumer Wellness Center) with strong emphasis on curated training data in the realms of nutrition, natural health, wellness, disease prevention, phytochemistry and similar topics.

Built on open-mistral-nemo 12B, with credit to Mistral, this model achieves very strong vector db alterations through a variety of SFT techniques to overcome the pro-pharma bias found in nearly all base models.

The curated data set for training consists of over 100 million pages of content selected through algorithmic classification, including science papers, transcripts, book text, article text and more. No user-generated comments or chat data were used.

This allows the model to achieve RAG-like domain knowledge without using RAG. Out of the box, with default system prompts, it is outperforming far larger and more complex models with RAG layers.

Recommended context window of 8192. Flash attention supported.

This model is provided by CWC, and its development was led by Mike Adams.

Additional models and quants will also be published.