Downloads · 30 days
7
0% of all-time downloads
olmoe_densebackward0125
autoprogrammer/olmoe_densebackward0125
olmoe_densebackward0125 is a machine learning model from autoprogrammer. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
自定义的OLMoE模型，使用DenseBackwardOlmoeSparseMoeBlock替换原版的MoE模块，实现dense backward功能。
All-time downloads
2.5K
Public
Parameters
6.9B
41.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors27.7 GB · 100%
At a glance
- Model type
- olmoe
- Access
- Public
- Created
- Mar 17, 2025
- Updated
- Jun 25, 2025
- SHA
- 5aa8b746
Model card
From the Hugging Face model README
DenseBackwardOLMoE
自定义的OLMoE模型，使用DenseBackwardOlmoeSparseMoeBlock替换原版的MoE模块，实现dense backward功能。
用法
from transformers import AutoConfig, AutoModelForCausalLM
# 使用trust_remote_code=True加载模型
config = AutoConfig.from_pretrained("autoprogrammer/olmoe_densebackward", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("autoprogrammer/olmoe_densebackward", config=config, trust_remote_code=True)
- Type
- olmoe
- Created
- Mar 17, 2025
- Updated
- Jun 25, 2025