Subalgebra generated by finitely many integral elements

If $a_1,\dots ,a_n$ are integral over $R$, then $R[a_1,\dots ,a_n]$ is a finitely generated $R$-module. In particular, every element of this subalgebra is integral over $R$.