KKT-consistent resolution of tied Lasso knots
ID: kkt-consistent-resolution-of-tied-lasso-knots
At a positive penalty level, let be the residual-score equality set, its signs and the nonzero regression coefficient support. With full column rank, the displayed strictly convex quadratic program selects the direction for a small decrease of the penalty. Existing nonzero regression coefficients have unrestricted tangent components; tied zero regression coefficients may move only with their residual signs. Stationarity gives for and for entering zero coordinates, and for tied coordinates that remain zero. These are exactly the first-order Karush-Kuhn-Tucker conditions for the Lasso along the next segment. Normalize to obtain the corresponding least-angle direction. This resolves simultaneous entries or dropouts without adding a generic-position assumption.
// Target: mathematical-optimization.bigb
New to topics? Read the docs here!