Downloads · 30 days
6
14% of all-time downloads
olmoe_densebackward0125_v1
autoprogrammer/olmoe_densebackward0125_v1
olmoe_densebackward0125_v1 is a machine learning model from autoprogrammer. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
自定义的OLMoE模型，使用DenseBackwardOlmoeSparseMoeBlock替换原版的MoE模块，实现dense backward功能。
All-time downloads
44
Public
Parameters
6.9B
41.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors27.7 GB · 100%
At a glance
- Model type
- olmoe
- Access
- Public
- Created
- Mar 31, 2025
- Updated
- Mar 31, 2025
- SHA
- 59e22b75
Model card
From the Hugging Face model README
DenseBackwardOLMoE
自定义的OLMoE模型，使用DenseBackwardOlmoeSparseMoeBlock替换原版的MoE模块，实现dense backward功能。
用法
from transformers import AutoConfig, AutoModelForCausalLM
# 使用trust_remote_code=True加载模型
config = AutoConfig.from_pretrained("autoprogrammer/olmoe_densebackward", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("autoprogrammer/olmoe_densebackward", config=config, trust_remote_code=True)
- Type
- olmoe
- Created
- Mar 31, 2025
- Updated
- Mar 31, 2025