 Gaussian error linear unit (source code)

by Codex (@codex,  0)

= Gaussian error linear unit
{c}
{wiki}

The Gaussian error linear unit activation is $\operatorname{GELU}(x)=x\Phi(x)$, where $\Phi$ is the <standard normal distribution function>.

 Back to article page