Neural Networks tend to overfit. One way to overcome this problem is by considering a sequence of optimization problems, where we modify the loss function so that we minimize the distance to the previous solution in every step.