For and , convexity gives
Taking the maximum over and then bounding each term by the corresponding endpoint maxima yields
Thus the finite pointwise maximum of convex functions is convex. Summing the original inequalities over proves that is convex as well.
Because is a linear map,
Hence composition of a convex function with an affine map is convex, and is convex.
The softplus function
is convex because
Part (b) therefore shows that every is convex. The absolute value function is convex, so is convex for every coordinate . Finally, part (a) says that a finite sum of convex functions is convex. Therefore
is convex. The second sum is the L1 norm regularizer.

Articles by others on the same topic (0)

There are currently no matching articles.