Ghost Attention (GAtt)
A training-data method that teaches a chat model to keep following an instruction given at the start of a conversation, such as "act as Napoleon", for many turns.
Introduced by
Llama 2, 2023
A training-data method that teaches a chat model to keep following an instruction given at the start of a conversation, such as "act as Napoleon", for many turns.
Llama 2, 2023