Self Supervised Learning

Self supervised learning vs unsupervised learning?

Self-supervised methods are just unsupervised methods, but specifically used to describe the Masked Language Model (MLM) methods used in natural language processing. In the task, the input sentences are randomly masked, and the mission of the model is to find out what the word that is masked is.