Masked language model
A pretraining task in which some tokens of a text are hidden and the model must predict them from the words on both sides. It is like a fill-in-the-blank test.
Introduced by
BERT, 2018
A pretraining task in which some tokens of a text are hidden and the model must predict them from the words on both sides. It is like a fill-in-the-blank test.
BERT, 2018