A family of actions is closed under counterterms when all required divergent local terms can be absorbed into that family. This does not imply that the full quantum effective action contains no additional finite effective interaction vertices or terms in its derivative expansion.
New to topics? Read the docs here!