Downloads · 30 days
8.5K
4% of all-time downloads
vaiv/GeM2-Llamion-14B-Base
GeM2-Llamion-14B-Base is a text generation model from vaiv. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
We have released Llamion as GeM 2.0, the second series of generative models developed by VAIV Company to address the our principal business needs.
Downloads · 30 days
8.5K
4% of all-time downloads
All-time downloads
190K
Public
Parameters
14.5B
29 GB on disk
Likes
6
Public
Click a slice to open those files.
.safetensors29 GB · 100%
From the Hugging Face model README
We have released Llamion as GeM 2.0, the second series of generative models developed by VAIV Company to address the our principal business needs.
Llamion (Llamafied Orion) is derived from transforming the Orion model into the standard LLaMA architecture through parameter mapping and offline knowledge transfer. Further technical specifications and study results are detailed in our paper.
<!-- Note that this model has NOT been contaminated to artificially inflate its scores for the Open LLM Leaderboards, unlike some recent models which have been intentionally tainted. -->