Downloads · 30 days
7
3% of all-time downloads
mdpr-adapter.w-mbert.pft-msmarco
crystina-z/mdpr-adapter.w-mbert.pft-msmarco
mdpr-adapter.w-mbert.pft-msmarco is a machine learning model from crystina-z. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
All-time downloads
271
Public
Repo size
1.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin719 MB · 99%
At a glance
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Apr 18, 2023
- Updated
- Apr 18, 2023
- SHA
- c8a0a92f
Model card
From the Hugging Face model README
Tevatron
bs=512
epoch=40
save_steps=4000
backbone=bert-base-multilingual-cased
output_dir=mlm.bs-$bs.epoch-$epoch.$backbone
WANDB_PROJECT=mlm-mrtydi-DDR \
python examples/dense-adapter/dense-adapter-train.py \
--output_dir $output_dir \
--model_name_or_path $backbone \
--tokenizer_name bert-base-multilingual-cased \
--save_steps $save_steps \
--dataset_name Tevatron/msmarco-passage \
--fp16 \
--per_device_train_batch_size $bs \
--train_n_passages 2 \
--learning_rate 1e-5 \
--q_max_len 32 \
--p_max_len 128 \
--num_train_epochs $epoch \
--logging_steps 100 \
--overwrite_output_dir \
--dataloader_num_workers 4 \
- Library
- transformers
- Type
- bert
- Created
- Apr 18, 2023
- Updated
- Apr 18, 2023