 Rectified linear unit

The rectified linear unit activation is $\mathrm{ReLU}(x)=\max (x,0)$.