Unbounded directional risk of fixed ridge shrinkage
ID: unbounded-directional-risk-of-fixed-ridge-shrinkage
For fixed positive ridge regression penalty, choose a unit eigenvector of with eigenvalue , and signal . The directional ridge risk is , whereas ordinary least squares has risk . Letting grow makes the ridge squared bias arbitrarily large.
New to topics? Read the docs here!