Downloads · 30 days
8
16% of all-time downloads
medium_8192sl_gpu_64bs__mamba
gmongaras/medium_8192sl_gpu_64bs__mamba
medium_8192sl_gpu_64bs__mamba is a machine learning model from gmongaras. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Weights for the softmax model from the paper 2Mamba2Furious: Linear in Complexity, Competitive in Accuracy. This model variant uses traditional mamba, used for the NIAH experiment. It was trained for 400K steps with a…
All-time downloads
51
Public
Parameters
682M
8.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt5.5 GB · 67%
At a glance
- Model type
- llama
- Access
- Public
- Created
- Feb 8, 2026
- Updated
- Feb 22, 2026
- SHA
- f3e45cc4
Model card
From the Hugging Face model README
Weights for the softmax model from the paper 2Mamba2Furious: Linear in Complexity, Competitive in Accuracy.
This model variant uses traditional mamba, used for the NIAH experiment. It was trained for 400K steps with a batch size of 32.
More details of the setup can be found in the Github repo.
Instructions on how to use this model can be found in https://github.com/gmongaras/2Mamba2Furious
- Type
- llama
- Created
- Feb 8, 2026
- Updated
- Feb 22, 2026