Order the observations so thatusing a fixed or randomized rule for ties. The L-nearest-neighbour classifier estimatesand predicts a class maximizing .
Conditional on , the selected class indicators are independent Bernoulli variables. ThereforeandTaking expectations proves the claim.
Let count sample points in the intersection of with the ball of radius around . That intersection has volume at least , so with . The event implies . Since and , Chebyshev inequality givesTaking the minimum with the trivial bound one proves the result.
Put and . If , the claim follows from . Otherwise, for , part (c) givesThe tail-sum formula then yields
By the Cauchy-Schwarz inequality, part (b), and part (e),This bound tends uniformly to zero ifThe plug-in classifier excess-risk bound then shows that the misclassification risk of the nearest-neighbour classifier converges to the Bayes risk.
Articles by others on the same topic
There are currently no matching articles.