Downloads · 30 days
22
3% of all-time downloads
mamba-2.8b-slimpj-bf16
Trelis/mamba-2.8b-slimpj-bf16
mamba-2.8b-slimpj-bf16 is a text generation model from Trelis. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a 16 bit version of Mamba-2.8b-slimpj
All-time downloads
807
Public
Repo size
11.1 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin5.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Jan 29, 2024
- Updated
- Jan 29, 2024
- SHA
- d803da11
Try a prompt
Datasets
Model card
From the Hugging Face model README
Mamba 2.8b Slim Pyjama - bf16 (16-bit)
This is a 16 bit version of Mamba-2.8b-slimpj
Mamba-2.8b-slimpj is a model using the Mamba architecture, with 2.8B parameters, trained for 600B tokens on the SlimPajama dataset.
Model code: https://github.com/state-spaces/mamba/tree/main
To load the model, follow the installation instruction in the code repo, and then:
from mamba_ssm.models.mixer_seq_simple import MambaLMHeadModel
model = MambaLMHeadModel.from_pretrained("state-spaces/mamba-2.8b-slimpj")
Inference Notebook (Colab)
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- Jan 29, 2024
- Updated
- Jan 29, 2024