Downloads · 30 days
7
20% of all-time downloads
olmoe_densebackward0125_new
autoprogrammer/olmoe_densebackward0125_new
olmoe_densebackward0125_new is a machine learning model from autoprogrammer. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
自定义的OLMoE模型，使用DenseBackwardOlmoeSparseMoeBlock替换原版的MoE模块，实现dense backward功能。
All-time downloads
35
Public
Parameters
6.9B
27.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors27.7 GB · 100%
At a glance
- Model type
- olmoe
- Access
- Public
- Created
- Jun 3, 2025
- Updated
- Jun 3, 2025
- SHA
- e97598c2
Model card
From the Hugging Face model README
DenseBackwardOLMoE
自定义的OLMoE模型，使用DenseBackwardOlmoeSparseMoeBlock替换原版的MoE模块，实现dense backward功能。
用法
from transformers import AutoConfig, AutoModelForCausalLM
# 使用trust_remote_code=True加载模型
config = AutoConfig.from_pretrained("autoprogrammer/olmoe_densebackward", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("autoprogrammer/olmoe_densebackward", config=config, trust_remote_code=True)
- Type
- olmoe
- Created
- Jun 3, 2025
- Updated
- Jun 3, 2025