mzbac

Kunpeng-4x7B-mistral

mzbac/Kunpeng-4x7B-mistral

Kunpeng-4x7B-mistral is a text generation model from mzbac. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

A Moe Model of "Mistral-7B-Instruct-v0.2", "Mistral-7B-v0.1", "Starling-LM-7B-alpha", and "Mistral-7B-Instruct-v0.1" then fine-tuned with "WizardLMevolinstruct70k" for qproj, vproj, and gate.