Downloads · 30 days
15
3% of all-time downloads
bitmamba-zen-distillix-300m
rileyseaburg/bitmamba-zen-distillix-300m
bitmamba-zen-distillix-300m is a machine learning model from rileyseaburg. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This is a 1.58-bit BitMamba (Zen) model trained via Superposition Distillation.
All-time downloads
435
Public
Repo size
3.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf1.3 GB · 54%
At a glance
- License
- mit
- Access
- Public
- Created
- Jan 7, 2026
- Updated
- Jan 8, 2026
- SHA
- 3133311d
Model card
From the Hugging Face model README
bitmamba-zen-distillix-300m
This is a 1.58-bit BitMamba (Zen) model trained via Superposition Distillation.
Model Details
- Teacher: Qwen/Qwen2.5-Coder-1.5B-Instruct
- Architecture: Mamba SSM (Zen Variant) + BitLinear (1.58-bit weights)
- Params: ~278M
- Training Data: CodeAlpaca (Distilled)
Usage
This model requires the custom BitMambaStudent class definition to run.
It was trained as a Proof-of-Concept for Superposition Distillation.
- License
- mit
- Created
- Jan 7, 2026
- Updated
- Jan 8, 2026