 Solution

Always true. Suppose $G=⟨g⟩$. If $H$ is nontrivial, let $d$ be the least positive integer with $g^d\in H$. For any $g^k\in H$, divide $k=qd+r$ with $0\le r<d$. Since $g^r=g^k(g^d{)}^{-q}\in H$, minimality forces $r=0$. Hence $H=⟨g^d⟩$ is a cyclic group. The trivial subgroup is cyclic as well. Every coset in $G/H$ is $g^{k}H=(gH{)}^k$, so the quotient group is generated by $gH$. This proves the subgroups and quotients of a cyclic group assertion.