Downloads · 30 days
12
3% of all-time downloads
t5-base-marco-crop-pretrain-2048
jmvcoelho/t5-base-marco-crop-pretrain-2048
t5-base-marco-crop-pretrain-2048 is a machine learning model from jmvcoelho. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
Model pre-trained on MS-MARCO (contrastive).
All-time downloads
403
Public
Repo size
892 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin892 MB · 100%
At a glance
- Library
- transformers
- Model type
- t5
- Access
- Public
- Created
- Feb 20, 2024
- Updated
- Jun 20, 2024
- SHA
- 8b479faa
Model card
From the Hugging Face model README
Model pre-trained on MS-MARCO (contrastive).
Starting model: jmvcoelho/t5-base-marco-lm-pretrain-2048
Training script: https://github.com/cxcscmu/LongEmbeddingAnalysis/blob/main/scripts/contrastive_pretrain_dr.sh
T5ForConditionalGenerationRoPE class: https://github.com/cxcscmu/LongEmbeddingAnalysis/blob/main/OpenMatch/src/openmatch/modeling/rope_t5.py
- Library
- transformers
- Type
- t5
- Created
- Feb 20, 2024
- Updated
- Jun 20, 2024