CT0-11B

How do I pronounce the name of the model? CT0 should be pronounced "C T Zero" (like in "Continual T5 for zero-shot")

Model Description

CT0 is an extention of T0, a model showing great zero-shot task generalization on English natural language prompts, outperforming GPT-3 on many tasks, while being 16x smaller.

@misc{scialom2022Continual,
      title={Fine-tuned Language Models are Continual Learners},
      author={Thomas Scialom and Tuhin Chakrabarty and Smaranda Muresan},
      year={2022},
      eprint={2205.12393},
      archivePrefix={arXiv},
      primaryClass={cs.LG}
}