hkunlp

T5_large_prefix_all_tasks_2upsample2

hkunlp/T5_large_prefix_all_tasks_2upsample2

T5_large_prefix_all_tasks_2upsample2 is a machine learning model from hkunlp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

This is the ckpt of prefix-tuning model we trained on 21 tasks using a upsampling temp of 2. Note: The prefix module is large due to the fact we keep the re-param weight and didn't compress it to make it more original…