The assertion is false. For , take the affine hypersurface
It is an integral scheme, and its only possible singular point is the origin, which has codimension two. Hence it is regular in codimension one; as a hypersurface it satisfies Serre's condition , so the Serre criterion for normality also makes it a normal scheme. The Divisor class group of an A-type surface singularity is
generated by . Thus a closed affine subscheme satisfying can have nonzero torsion in its class group.
For a point , let be the image of in its residue field . The scheme-theoretic fiber is
If , then . The quadratic polynomial is irreducible. Indeed, after setting , any hypothetical linear factors must restrict, up to nonzero scalars, to and ; comparing the and coefficients then forces both coefficients to vanish, contradicting the nonzero coefficient. Hence its homogeneous coordinate ring is an integral domain, so is an integral scheme.
At the origin , the fiber is , the union of the two distinct projective lines and , and is therefore not irreducible. It is nevertheless a reduced scheme because the ideal equals its radical. Every other fiber is integral and hence reduced. Thus the fiber is integral exactly away from the origin, and it is reduced at every point of .