Downloads · 30 days
12
3% of all-time downloads
sail/tapex-zero-large
tapex-zero-large is a machine learning model from sail. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
TAPEX Zero is a novel approach for instruction tuning that leverages synthetic tasks to improve the performance of language models on unseen tasks. The proposed approach utilizes symbolic tasks for instruction tuning,…
Downloads · 30 days
12
3% of all-time downloads
All-time downloads
406
Public
Repo size
6.3 GB
Likes
3
Public
Click a slice to open those files.
.bin3.1 GB · 100%
From the Hugging Face model README
TAPEX Zero is a novel approach for instruction tuning that leverages synthetic tasks to improve the performance of language models on unseen tasks. The proposed approach utilizes symbolic tasks for instruction tuning, which has demonstrated its effectiveness in enhancing the performance of language models on unseen tasks, as exemplified by the case study on zero-shot table reasoning.
The model is trained on a variety of datasets that include symbolic tasks such as SQL queries. The training data also includes generic datasets to ensure that the model maintains its original performance on those datasets.
As with any machine learning model, TAPEX Zero may have limitations and biases based on the training data it was exposed to. It may not perform well on tasks that are significantly different from those in the training data. Additionally, since symbolic tasks are generated by programs, they may not fully capture the complexity and variability of human-generated instructions.
The code used to train TAPEX Zero is available at https://github.com/sail-sg/symbolic-instruction-tuning