One-nearest-neighbour asymptotic risk
ID: one-nearest-neighbour-asymptotic-risk
For binary classification, write and assume feature-measurable nearest-neighbour tie-breaking. If , then the expected conditional misclassification risk of the one-nearest-neighbour classifier tends to . Couple each label and an oracle label using one uniform variable. Their disagreement has the preceding expected absolute difference. The oracle and the test label are conditionally independent Bernoulli random variables of parameter , so their disagreement probability is exactly . The difference of classification in statistical learning error probabilities is at most the coupling disagreement.
New to topics? Read the docs here!