For a proper subgroupH of any groupG, its complement is a generating set of a group. Choose x∈/H. For every h∈H, also xh∈/H, and h=x−1(xh) lies in the subgroup generated by the complement. That subgroup consequently contains both H and its complement. No finiteness assumption is needed.