Gaussian identity design for debiased Lasso
ID: gaussian-identity-design-for-debiased-lasso
In the normal linear model, assume is independent of . Independent rows of with multivariate normal distribution give a simple random design for Debiased Lasso. Let , and , with fixed positive noise scale. Choose the Lasso penalty and all Nodewise Lasso penalties as sufficiently large constant multiples of , including the noise scale in the former. Uniform sample cross-correlations are bounded by this scale, so zero is the nodewise solution with probability tending to one. Column squared norms divided by converge uniformly to one. To check the Compatibility condition for the Lasso directly, put and . On the Lasso cone condition, , and the Cauchy-Schwarz inequality givesFor , entrywise concentration of a Gaussian Gram matrix gives with probability tending to one for sufficiently large fixed . The stated sparsity condition implies on this event, so one can take eventually. The conditional Gaussian tail bound for the noise score and the Basic inequality for the Lasso then give with probability tending to one. Consequently the debiased-Lasso remainder bound is at most with probability tending to one, for a fixed constant . These assumptions allow both and to grow, for example , .
New to topics? Read the docs here!