Sigmoid function
= Sigmoid function
{wiki}
The sigmoid function
$$
\sigma(x)=\frac{1}{1+e^{-x}}
$$
is a smooth activation function with derivative $\sigma'(x)=\sigma(x)(1-\sigma(x))$.
= Sigmoid function
{wiki}
The sigmoid function
$$
\sigma(x)=\frac{1}{1+e^{-x}}
$$
is a smooth activation function with derivative $\sigma'(x)=\sigma(x)(1-\sigma(x))$.