Neural network bias
= Neural network bias
The learned additive constant in a unit preactivation, $a=w^Tz+b$. It can be represented by weight $w_0=b$ on a constant input $z_0=1$.
= Neural network bias
The learned additive constant in a unit preactivation, $a=w^Tz+b$. It can be represented by weight $w_0=b$ on a constant input $z_0=1$.