In-context learning
When a model does a new task from instructions or examples written in its input, without any change to its weights. It works only during that one input; nothing is stored afterwards.
Introduced by
GPT-3, 2020
Used by
- Chain of thought, 2022
- Flamingo, 2022