Downloads · 30 days
212
44% of all-time downloads
mamba2-distilled-small
ycwu97/mamba2-distilled-small
mamba2-distilled-small is a text generation model from ycwu97. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
2 layer mamba2 models distilled from JunxiongWang/Llama3.2-Mamba2-3B-distill. Early stop at 48000 step.
All-time downloads
483
Public
Repo size
1.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin605 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jun 3, 2025
- Updated
- Oct 29, 2025
- SHA
- 546ad7a0
Try a prompt
Base models
Model card
From the Hugging Face model README
Description
2 layer mamba2 models distilled from JunxiongWang/Llama3.2-Mamba2-3B-distill. Early stop at 48000 step.
Used in STree: Speculative Tree Decoding for Hybrid State-Space Models as a draft model for speculative decoding for hybrid models.
For more details on installation, training, and evaluation, please refer to the GitHub repository.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Jun 3, 2025
- Updated
- Oct 29, 2025