Downloads · 30 days
6
10% of all-time downloads
t5-small_dff2048_dmodel32_token-pattern-predictor_switch128_wmt16
marsggbo/t5-small_dff2048_dmodel32_token-pattern-predictor_switch128_wmt16
t5-small_dff2048_dmodel32_token-pattern-predictor_switch128_wmt16 is a machine learning model from marsggbo. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
60
Public
Repo size
30.5 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin15.3 MB · 100%
At a glance
- Model type
- t5
- Access
- Public
- Created
- Sep 19, 2024
- Updated
- Sep 19, 2024
- SHA
- 1d6929ab
Base models
Model card
From the Hugging Face model README
- Download the repo
import os
import torch
from glob import glob
from transformers import AutoModelForSeq2SeqLM, AutoConfig
model_name = 'marsggbo/t5-small_dff2048_dmodel32_token-pattern-predictor_switch128_wmt16'
# ignore the mismatched size, because lm_head was modified
model = AutoModelForSeq2SeqLM.from_pretrained(
model_name, ignore_mismatched_sizes=True, use_safetensors=False
)
- Build the model
home_path = os.path.expanduser('~')
num_classes = 128 # switch128
ckpt_path = f"{home_path}/.cache/huggingface/hub/*{model_name.split('/')[-1]}/snapshots/*/*bin"
ckpt_path = glob(ckpt_path)[0]
model_config = AutoConfig.from_pretrained(model_name)
model = AutoModelForSeq2SeqLM.from_config(config=model_config)
model.lm_head = torch.nn.Linear(model.config.hidden_size, num_classes*6, bias=False)
model.load_state_dict(torch.load(ckpt_path, map_location='cpu'), strict=True)
- Type
- t5
- Created
- Sep 19, 2024
- Updated
- Sep 19, 2024