Next sentence prediction
A pretraining task in which the model sees two spans of text and predicts whether the second really follows the first or was chosen at random.
Introduced by
BERT, 2018
A pretraining task in which the model sees two spans of text and predicts whether the second really follows the first or was chosen at random.
BERT, 2018