Downloads · 30 days
16
4% of all-time downloads
mamba_ml_abstract
pt-sk/mamba_ml_abstract
mamba_ml_abstract is a machine learning model from pt-sk. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
This model uses Mamba Architecture trained on a research abstract dataset.
All-time downloads
424
Public
Repo size
4.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
Other1.5 GB · 75%
At a glance
- Library
- transformers
- License
- mit
- Access
- Public
- Created
- May 20, 2024
- Updated
- May 23, 2024
- SHA
- 6e43012e
Datasets
Model card
From the Hugging Face model README
This model uses Mamba Architecture trained on a research abstract dataset.
- Optimizer: AdamW
- Leanring Rate: 0.001
Import the scripts from the code folder
from model import Mamba, ModelArgs
Loading Model
mamba_model = Mamba.from_pretrained("pt-sk/mamba").to("cuda")
Loading Tokenizer
tokenizer = AutoTokenizer.from_pretrained('pt-sk/mamba')
mamba_reserach file contains the state dict of optimizer and the model.
- Library
- transformers
- License
- mit
- Created
- May 20, 2024
- Updated
- May 23, 2024