chargoddard

demixtral

chargoddard/demixtral

demixtral is a machine learning model from chargoddard. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

Contains eight Mistral models using the MLP layers from the corresponding Mixtral expert. Note that the ordering of experts between layers is arbitrary, so this is not the only (and almost certainly not the best) extr…