Downloads · 30 days
10
14% of all-time downloads
MambaSan-370m-instruct
loiccabannes/MambaSan-370m-instruct
MambaSan-370m-instruct is a machine learning model from loiccabannes. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
72
Public
Repo size
709 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin709 MB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Feb 11, 2024
- Updated
- Feb 11, 2024
- SHA
- d132d33c
Datasets
Model card
From the Hugging Face model README
MambaSan-370m-instruct 🐍
MambaSan-instruct is the first chat Japanese language model based on a state-space model architecture (Mamba).
The model is based on Albert Gu's and Tri Dao's work Mamba: Linear-Time Sequence Modeling with Selective State Spaces (paper) as well as their model implementation. This work was also inspired by heavenq's mamba-chat implementation in English.
Mamba-Chat is based on MambaSan-370m and was fine-tuned on 31,7k examples samples of the SkelterLabsInc/JaQuAD dataset. To learn more, you can:
- Take a look at the model on Huggingface 🤗
- Talk to Mamba-Chat on Google Colab
The Code used for pretraining and finetuning will soon be published on my github: https://github.com/lcabannes Citation
bibtex @misc{lcabannes2024MambaSan-370m-instruct, title = {MambaSan-370m-instruct}, author = {Loïc Cabannes}, year = {2024}, howpublished = {HuggingFace}, url = {https://huggingface.co/loiccabannes/MambaSan-370m-instruct/} }
- Library
- transformers
- License
- apache-2.0
- Languages
- ja
- Created
- Feb 11, 2024
- Updated
- Feb 11, 2024