Downloads · 30 days
0
O2iginal/based-distill56l-dclm10b-s4k-final-mamba_hy-2.9b-A0-hd64-ng6-msdim320-me1-bs1024-sl32768
based-distill56l-dclm10b-s4k-final-mamba_hy-2.9b-A0-hd64-ng6-msdim320-me1-bs1024-sl32768 is a machine learning model from O2iginal. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is a model uploaded from /mnt/nanjingcephfs/projectwx-rec-alg-bdc-exp/bwzheng/yulan/hyw/pretrain-linear-moe-dev/megatronlmworkspace/checkpoint/based-distill56l-dclm10b-s4k-final-mambahybrid-2.9b-112layers-q30-kv6…
Downloads · 30 days
0
Access
Public
Updated Sep 18, 2025
Repo size
40.6 GB
Likes
0
Public
Click a slice to open those files.
.pt40.6 GB · 100%
From the Hugging Face model README
This is a model uploaded from /mnt/nanjingcephfs/project_wx-rec-alg-bdc-exp/bwzheng/yulan/hyw/pretrain-linear-moe-dev/megatron_lm_workspace/checkpoint/based-distill56l-dclm10b-s4k-final-mamba_hybrid-2.9b-112layers-q30-kv6-hybrid0.0625-pattern_A0-mheaddim64-mnumgroups6-mstatedim320-mexpand1-freeze_false-ep1-mp2-pp1-cp2-lr2e-5-minlr7e-7-bs1024-gpus8-seqlen32768.