Binary threshold unit
= Binary threshold unit
{title2=$z=H(\sum_iw_iz_i-\theta)$}
A <binary threshold unit> outputs one when its weighted input reaches its threshold and zero otherwise. Its hard threshold is not differentiable, so ordinary <backpropagation> cannot directly train the exact threshold model. Smooth <activation functions> can approximate its computation.