Downloads · 30 days
60
2% of all-time downloads
arianraje/mimo-7b-gdn-hybrid-1B-OPD
mimo-7b-gdn-hybrid-1B-OPD is a machine learning model from arianraje. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Full state (BF16 model shards + FP32 optimizer shards + trainerstate) of the MiMo-7B GDN-hybrid OPD run mimo-wsd-rugfix-h200x3-ext800-decay0-v1 (W&B id mimo-rugfix-h200x3-ext800-decay0-v1-20260816) at step 6454 / 1,00…
Downloads · 30 days
60
2% of all-time downloads
All-time downloads
3.7K
Public
Parameters
8.3B
116 GB on disk
Likes
0
Public
Click a slice to open those files.
.pt99.7 GB · 86%
From the Hugging Face model README
Full state (BF16 model shards + FP32 optimizer shards + trainer_state) of the
MiMo-7B GDN-hybrid OPD run mimo-wsd-rugfix-h200x3-ext800-decay0-v1
(W&B id mimo-rugfix-h200x3-ext800-decay0-v1-20260816) at step 6454 /
1,000,002,516 consumed tokens, H=32K. Saved on the Empire 3xH200 7-day
reservation (job 16007, WSD OPD scaling ladder). This is the decayed ext800 (1B) final state at the rung endpoint.
Custom mimo_gdn architecture - register before loading (see project repo).
Source Git commit: e3cc4c0ff85a10b0660af706e80f21bfb252677b