Text-to-text format
Writing every task as text in and text out, with a short prefix that names the task. One model, one training objective and one way of decoding can then serve translation, classification, summarisation and more.
Introduced by
T5, 2019
Used by
- T0, 2021
- Flan-T5 / Flan-PaLM, 2022