Softplus function
= Softplus function
{title2=$\log(1+e^x)$}
{wiki=Softplus}
The softplus function $s(x)=\log(1+e^x)$ is convex because
$$
s''(x)=\frac{e^x}{(1+e^x)^2}>0.
$$
= Softplus function
{title2=$\log(1+e^x)$}
{wiki=Softplus}
The softplus function $s(x)=\log(1+e^x)$ is convex because
$$
s''(x)=\frac{e^x}{(1+e^x)^2}>0.
$$