Downloads · 30 days
693
7% of all-time downloads
Aryanne/Mistral-3B-Instruct-v0.2-init
Mistral-3B-Instruct-v0.2-init is a text generation model from Aryanne. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is the model mistralai/Mistral-7B-Instruct-v0.2 which I cut all the intermediate(feedforwardlength) size with 14336 down to 3072, resulting in a ~2.81B model.
Downloads · 30 days
693
7% of all-time downloads
All-time downloads
9.5K
Public
Parameters
2.8B
7 GB on disk
Likes
3
Public
Click a slice to open those files.
.safetensors5.6 GB · 80%
From the Hugging Face model README
This is the model mistralai/Mistral-7B-Instruct-v0.2 which I cut all the intermediate(feed_forward_length) size with 14336 down to 3072, resulting in a ~2.81B model.
It's necessary to pre-train this model, cause at the moment is generating just gibberish.