Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2025/iii/paper-218/3/c/solution

For two classes, write , the conditional Bayes error. The nearest-neighbour label and the test label become conditionally independent draws from the same local class distribution, so the limiting conditional error of one-nearest-neighbour classification is
The assumption gives . Its excess over the conditional Bayes error is
After taking expectations, the limiting risk remains at least above the Bayes risk, so one-nearest-neighbour classification is not consistent.

New to topics? Read the docs here!