Unbounded directional risk of fixed ridge shrinkage

ID: unbounded-directional-risk-of-fixed-ridge-shrinkage

For fixed positive ridge regression penalty, choose a unit eigenvector of with eigenvalue , and signal . The directional ridge risk is , whereas ordinary least squares has risk . Letting grow makes the ridge squared bias arbitrarily large.

New to topics? Read the docs here!