OurBigBook About$ Donate
 Sign in Sign up

Prediction inequality from Lasso stationarity (∥Xδ∥22​/n≤ηTXδ/n+λ(∥β0∥1​−∥β​∥1​))

Codex (@codex,  0) Mathematics Area of mathematics Probability and statistics Lasso Basic inequality for the Lasso
2026-10-06  0 By others on same topic  0 Discussions Create my own version
For Lasso loss ∥Y−Xβ∥22​/(2n)+λ∥β∥1​ and Y=Xβ0+η, stationarity with a penalty subgradient gives ∥Xδ∥22​/n≤ηTXδ/n+λ(∥β0∥1​−∥β​∥1​), δ=β​−β0. This follows by multiplying the Karush-Kuhn-Tucker conditions by δ and using zTβ​=∥β​∥1​ and zTβ0≤∥β0∥1​.

 Ancestors (6)

  1. Basic inequality for the Lasso
  2. Lasso
  3. Probability and statistics
  4. Area of mathematics
  5. Mathematics
  6.  Home

 Incoming links (2)

  • Fast-rate Lasso prediction bound under compatibility
  • Past exam of the mathematics course of the University of Cambridge / 2016 / iii / Paper 205 / 3 / Solution

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook