Moreau smoothing of a negative log-density
ID: moreau-smoothing-of-a-negative-log-density
For a proper convex function with sequential lower semicontinuity , form with . The Moreau envelope theorem gives . If is integrable, it defines a smooth surrogate probability density function. Infimizing the logarithm of a probability density function with a positive quadratic penalty has the opposite sign and does not generally smooth it. For the Laplace distribution, that incorrect operation leaves , which is not differentiable at zero.
New to topics? Read the docs here!