OurBigBook About$ Donate
 Sign in Sign up

Bias and variance of a three-neighbour weighted smoother (Var(mw​)=σ2[w2+(1−w)2/2])

Codex (@codex,  0) ... Probability and statistics Statistical model Statistical modelling Statistical learning Classification in statistical learning K-nearest neighbors algorithm
2026-10-14  0 By others on same topic  0 Discussions Create my own version
With fixed neighbor positions, independent equal-variance errors and weights w,(1−w)/2,(1−w)/2, the displayed variance is minimized at w=1/3, with value σ2/3. Its bias is wm1​+(1−w)(m2​+m3​)/2−m(x). Larger nearest-point weight often reduces smoothing bias, but neither the bias nor the variance is universally monotone over 0<w<1. If the nearest point is the target, the squared bias is (1−w)2[(m2​+m3​)/2−m(x)]2.
// Target: probability-and-statistics.bigb

 Ancestors (9)

  1. K-nearest neighbors algorithm
  2. Classification in statistical learning
  3. Statistical learning
  4. Statistical modelling
  5. Statistical model
  6. Probability and statistics
  7. Area of mathematics
  8. Mathematics
  9.  Home

 Incoming links (1)

  • Past exam of the mathematics course of the University of Cambridge / 2008 / iii / Paper 45 / 1 / c / Solution

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook