Downloads · 30 days
0
RinKana/Amadeus-RNN-4.7M-B
Amadeus-RNN-4.7M-B is a machine learning model from RinKana. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Amadeus-RNN-4.7M-B A lightweight linear RNN with data-dependent gating and parallel associative scan (SSM-style training). Trained on TinyStories. 4.7M parameters, runs on consumer GPU (<2GB VRAM).
Downloads · 30 days
0
Access
Public
Updated Aug 29, 2026
Repo size
18.9 MB
Likes
0
Public
Click a slice to open those files.
.safetensors18.9 MB · 100%
From the Hugging Face model README
Amadeus-RNN-4.7M-B A lightweight linear RNN with data-dependent gating and parallel associative scan (SSM-style training). Trained on TinyStories. 4.7M parameters, runs on consumer GPU (<2GB VRAM).
Architecture: Linear RNN · O(T log T) associative scan · Mamba-inspired λ gate · Custom BPE tokenizer (vocab=4096)
Training: TinyStories · 2-3hrs · RTX 3060 Mobile · PyTorch + AMP