Downloads · 30 days
6
17% of all-time downloads
Jashan887/91_Mamba_SSM_Efficiency
91_Mamba_SSM_Efficiency is a machine learning model from Jashan887. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Mamba-2.8b-slimpj is a model using the Mamba architecture, with 2.8B parameters, trained for 600B tokens on the SlimPajama dataset.
Downloads · 30 days
6
17% of all-time downloads
All-time downloads
35
Public
Repo size
—
Likes
0
Public
Click a slice to open those files.
.bin11.1 GB · 100%
From the Hugging Face model README
Mamba-2.8b-slimpj is a model using the Mamba architecture, with 2.8B parameters, trained for 600B tokens on the SlimPajama dataset.
Model code: https://github.com/state-spaces/mamba/tree/main
To load the model, follow the installation instruction in the code repo, and then:
from mamba_ssm.models.mixer_seq_simple import MambaLMHeadModel
model = MambaLMHeadModel.from_pretrained("state-spaces/mamba-2.8b-slimpj")