Replace the th example of to obtain . The population-loss term changes by at most by the assumed uniform stability of a learning algorithm. In the empirical average, each of the unchanged examples contributes a change at most . For the replaced term, first change the hypothesis, costing at most , and then change the evaluated example; boundedness of the loss costs at most . Thus the empirical term changes by at most
Combining the two terms gives
In statistical learning theory, Stability measures how much a learned predictor or its loss changes when the training sample is perturbed. Uniform stability of a learning algorithm imposes a bound valid at every test example.