Downloads · 30 days
154
0% of all-time downloads
mamba-chat
havenhq/mamba-chat
mamba-chat is a machine learning model from havenhq. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Mamba-Chat is the first chat language model based on a state-space model architecture, not a transformer.
All-time downloads
112K
Public
Repo size
11.1 GB
Likes
101
Public
Repo makeup
Click a slice to open those files.
.bin5.5 GB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Dec 6, 2023
- Updated
- Dec 8, 2023
- SHA
- d343f8ad
Model card
From the Hugging Face model README
Mamba-Chat is the first chat language model based on a state-space model architecture, not a transformer.
The model is a fine-tune of Albert Gu's and Tri Dao's model Mamba-2.8B from their paper Mamba: Linear-Time Sequence Modeling with Selective State Spaces.
Check our our Github repository for training and inference code.
The prompt format is the zephyr format:
<|user|> {user_message}
<|assistant|> {assistant_message}
<|user|> {user_message}
<|assistant|> {assistant_message}
- Library
- transformers
- License
- apache-2.0
- Created
- Dec 6, 2023
- Updated
- Dec 8, 2023