Moreau smoothing of a negative log-density

ID: moreau-smoothing-of-a-negative-log-density

For a proper convex function with sequential lower semicontinuity , form with . The Moreau envelope theorem gives . If is integrable, it defines a smooth surrogate probability density function. Infimizing the logarithm of a probability density function with a positive quadratic penalty has the opposite sign and does not generally smooth it. For the Laplace distribution, that incorrect operation leaves , which is not differentiable at zero.

New to topics? Read the docs here!