lodrick-the-lafted

Emu3-Gen-12B

lodrick-the-lafted/Emu3-Gen-12B

Emu3-Gen-12B is a text generation model from lodrick-the-lafted. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

This is an interpolated upscale of BAAI/Emu3-Gen from 8B to 11.5B. For each layer in [7,8,9,10,11,12,13,14,15,16,22,23,24], the weights were lerp'd between the previous layer and the current and inserted between the two.